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Chapter I 

I. INTRODUCTION 

This volume presents four internal school cost-effectiveness 
models for implementing planned changes in schools. 

&) The School Process Model (SPM) is presented in 
the form of a planbook entitled "Operation Self- 
Renewal" (OSR). The OSR Planbook is designed to assist 
in identifying problem areas within the school, 
developing appropriate and potentially cost-effective 
program solutions to identified problems, and testing 
and revising those programs until they can become 
"normal" school process components. 

h) The Teacher Evaluation Model (TEM) is also pre- 
sented in workbook form. Its principal uses are: 
developing an "in-service" strategy for increasing 
teacher effectiveness; and providing an objective 
data base for teacher advancement decisions. 

c) The Curriculum Evaluation Model (CEM ) is an 
instrumented technique for determining cost- 
effectiveness of alternative curriculum materials. 

d) The Instructional Process Model (IPM) is designed 

to generate and/or evaluate cost-effective educational 
programs directed toward specific instructional 
objectives both inside and outside of the classroom. 

The relationship of these four models to each other is depicted 
in a general way in the diagram below. A more specific flow chart 
showing the working relationship of the models to each other will be 
found in the next section. 
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Whatever other objectives the four internal school cost-effectiveness 

models may serve, their principal aim coincides with the chief goal of 

elementary and secondary schools: the increase of appropriate student 
* 

achievement and satisfaction. 

2. SCHOOL C/E MODELS 1 APPLICATIONS 
a. Statement of Need 

The need for change in schools is developed in some detail in 
the "Introduction" to Operation Self-Renewal beginning on page 3-12 
of this Volume. 



b. Problems of Application and Implementation. 

The application of any one or all of the internal school models 
at the local school level by a principal or other school administrator 
implies a willingness to learn and to change. 

Herein lies a problem. School administrators often resist 
change because it is time -costly and time is always seen as a scarce 
commodity, or because past attempts have been irregular and often 
abortive. Or because results have not seemed commensurate with effort. 

Yet if key administrators do not take positive leadership in the 
effort to improve the total educational ecology of their school (directed 
toward graduating more students, who have achieved more, at a 
higher level, and who are better equipped to make the transition into 
further education and employment) it is unlikely that positive change 
will happen. 

Application of these models must also deal with the problem of 
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"authority. " If a school administrator is "required" to implement 
a process for change it is likely that he will "require" participation 
of staff and teachers who, in turn, will demand that students participate, 
willingly or not, in fulfilling at least the .etter of the requirement, if not 



the spirit. But it is precisely the "spirit" that will usually determine 
whether a proposed change will succeed or fail. 

On the other hand, unplanned participation can lead to equally 
unhappy results: a process begun which raises expectations and then 
is not well carried through raises formidable resistance to future 
attempts. It is not better (as far as school systems are concerned) 
to have half-tried and failed than not to have tried at all. 

School administrations are appropriately concerned with the 
allocation of scarce resources: time, personnel, space, money. And 
while it is true that any complex process can be modeled, the use of 
a model in real life situations requires: reason, commitment, flexibility 
openness --in short, art. 



c. Strategies for Implementation of Internal School Models. 

Getting people to undertake programs for change is difficult 
under the best of circumstances. This is particularly true in schools. 
Hence, strategic considerations for "capturing" the attention and 
energy of key personnel are of paramount importance. No matter how 
effective in the abstract an instrumented model for change is, it is 
worthless if it is not used. The following specific strategies are re- 
commended in decreasing rank order of anticipated effectiveness: 

1) Change Workshops --small intense workshops of no 
more than 12 principals and superintendents from 
widely diverse schools geographically, but relatively 
similar in size for 7 to 10 days in the late summer 
or early fall. The purpose would be to introduce 
and to familiarize by simulation, key administrators 
in the use of the four internal models. As part of 
the exercise, participants would be asked to help 
refine the models. This group would also become 
a primary inter-supportive task group, sharing by 
letter and phone their actual experiences with the 
use of the models during the year. If cost necessitated, 
one pilot workshop could be developed which would 
form the basis for training administrator's to train new 
administrators the following summer after a year's 
experience with application of the models. 







2) Demonstrations: in this strategy, a "preceptor" well- 
versed in the models and their implementation would 
visit a number of schools for at least a week, and work 
with the principal or superintendent in situ to start- 
up model use. He would be available by telephone or 
short return visit to help where snags arose or 
additional support were needed. 

3) Direct explanation: a one-time visit to the local 
school chief administrator for a "sales" approach 
to the purpose and method of the cost-effectiveness 
internal school models. 

4) Written Introductions: here the entry of the model 
into the school would be by written explanation only 
in the form of programmed instruction for model 
application, 

5) Media Support Possibilities: each of the four strategies 
above would be materially enhanced by the addition of 
media support in the form of: an introductory film, or 
slides and tapes. Such support would be virtually 
necessary for direct explanation or written introduction 
of the models. 

d. Continuing Model Refinement 

The four models as they appear in this section are untested. 
Refinement of the models through actual use will have two important 
results: 1) the models will become more practical instruments for 

change as they are adapted on the basis of experiential data, and 
2) they are sufficiently "open" to invite a strong sense of participation 
in the final design process by the user. 



3. SCHOOL C/E MODEL MIX 

On the next page is a flow chart indicating the relationship of 
the four internal school models to an overall change process. The 
models can be used separately, or in a variety of combinations. 

The School Process Model - "Operation Self-Renewal" has been 
developed to provide an overall approach to change in the school. 

The other three models detail specific response to critical areas 
of school process: teachers, cur riculum, instruction. Program 

solutions to problems can come from two sources: internal-- 
developed within the school, and external --such as the possible 
programs developed by Abt Associates appearing in Volume II, or 
from other sources. The model mix and use will vary from school 
to school. 
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Chapter II 



NOTE 



What follows is the School Process Model in workbook form: 
Operation Self-Renewal Planbook. " 

The following presentation format is implied in the narrative: 

1. The OSR Planbook is a package: containing: 

i 

a. One master planbook for the Principal with material 

as presented here. 

b. Five planbooks with the following material deleted: 

FOREWARD, MEMORANDUM, QUESTIONNAIRE A, 
NARRATIVE: all steps 

c. One "Work-kit" containing: 5 OSR FEEDBACK 

QUESTIONNAIRES, 6 QUESTIONNAIRE A' s, 6 
STEP 2 AGENDAS, 10 OSR PREPARATION AND 
DEVELOPMENT LOGS, 10 OSR MASTER FLOW 
CHARTS. 

2. The OSR Planbook os 3 -hole punched and bound in loose 
leaf notebooks. The "Work-kit" is bound in a similar 
fashion. 

3. The Planbook may be more effectively presented if the 

Flow charts are color coded: PREPARATION - red, 
DEVELOPMENT - yellow, ACTION - green. 
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FOREWORD 



Dear Principal: 

If you are already convinced of the need for self- renewal in your 
school, and want to get going in a hurry, 

or 

if you are terribly busy, and don't know whether you're interested in 
self- renewal or not, 

then 

skip ahead to the MEMORANDUM to the Principal on page 8-17. 

If you can take the time (regardless of your current attitude toward 
school self-renewal through a planned process), read carefully the Intro- 
duction which follows the table of contents . 

OPERATIONS SELF-RENEWAL PLANBOOK is simply a tool to help 
you do your job more effectively. 

As such it is neutral about specific changes that might benefit your 
school. It is a response to wide-spread need for a way to attack a host 
of serious problems in a rational and meaningful way. And it does pre- 
suppose that meaningful change can be planned and carried out for the 
purpose of promoting measurable gains in student achievment and satis- 
faction. 

What your specific school problems are, and what specific projects 
might be remedial in meeting those problems at reasonable costs, only 
you and members of your school community can determine. 
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Historically change in schools has been: 
drifting 
sporadic 

the result of external pressures 

expedient 

in bits and pieces 

too little too late 

superficial 

related to narrow self-interest 

The sense of powerlessness to effect meaningful, rational, and life- 
renewing growth generally comes from baffled response to institutional 
complexity and lack of honest communication. This sense of powerless - 
ness is often equally, though unknowingly, shared by administrators, 
teachers, students, and parents. 

When a process for managing complexity and developing honest com- 
munication is adopted, and adapted to particular school situations, each 
element in a school community can creatively engage in solving real 
common problems . 

Schools can change through planning which is : 
democratic 
rational 

responsive to individual needs 

in tune with larger patterns of change 

continuous 

an expression of conviction 
internally generated 
timely 

designed to do the educational job better 
basic to educational functions 
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| Why have schools historically changed in a non -rational 

M 

I way? After all, they are ostensibly dedicated to rationality, and 

I ^he development, transmission and utilization of knowledge. 

I Matthew Miles, in an article entitled "Some Properties of 

| Schools as Social Systems"* has distilled some of the major features, 

| properties, and problems of American public schools. A summary 

\ of his analysis is presented here . It is compelling evidence both of 

| nee d for planned change, and of the nature of resistance to cl ange. 
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A. 



B. 



General features of the school in America 

1. the school is a social construct which exists to bring 
about "wanted" changes in the child. 

2. the school is usually organized on the basis of local 
control and financing. 

3. the school is a compulsory institution 

4. the school is de facto unconnected with other institutional 
elements of society whose function is, at least in part, 
changing children (e, g. , family, welfare, police, courts, 
employers, political groups). 

5. the school is in covert vertical linkage with colleges, graduate 
schools, accrediting agencies, state departments of education, 
and the educational bureaucracies of the Federal Government. 
There is also a horizontal linkage to the mass media and 
manufacturers and retailers of educational hard and software. 

Essential properties of schools 

1. Goal diversity and conflict: 

a) because of multiple expectations from community sub- 
constituencies schools 1 goals are usually abstract, 
numerous and given shifting priorities, often in conflict 
with one another. (Although subject-matter achievement, 
socialization, and custodial care would account for the 
broad categories in rank order. ) 



b) school goals carry heavy emotional freight in so far as 
children are "valuable property. " 

c) given the above conditions and the long-term longitudinal 
nature of behavior change in school children, there has 
been and is great difficulty in measuring the "product" 
outcomes in any systematic, statistically significant, and 

^op cit. , Change in School Systems , NTL, 1967, Pages 1-29. 
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meaningful ways. 

d) school goals are rarely, if ever, related to learner 
perceived needs and goals. 

2. The mechanisms for achieving school goals and attendant 

problems. 

a) students are primarily age-graded, yet exhibit wide 
difference in achievement ability 

b) teaching, the basic role performance in school, 
takes place 90% of the time without adult contact, 
support or supervision. 

c) stereotypical response to teacher role is highly uniform 
and the role itself is relatively static in terms of upward 
mobility. The demands of the stereotype plus the 
subject matter and classroom demands tend to make 

the teacher by far the most "active" (60-80%) participant 
in the classroom process. 

d) school work -flow decisions tend to lean on tradition 
rather than the results of inquiry into the work process 
(learning, developmental, social, psychology). 

e) hence educational innovation becomes exceptionally 
difficult in practice (much too easy in theory) because 
it necessarily involves human interaction and training 
retraining components. 

f) "... a major untapped resource in any school is the ideas 
and reactions of children about the efficacy of the education 
procedures in which they are involved, the role behaviors 
which are being presented to them, and possible innovations 
which would improve task accomplishment and emotional 
climate. Direct feedback channels from this point of view, 
are much needed. "2 

3. Commitment of school members to goal achievement 

a) schools have very low interdependence of various parts 
of the system: e.g. teachers are relatively isolated from 
adult contact during the day. Low interdependence makes 
planned change more difficult. 

b) Low role mobility, and career patterns of people entering 
teaching make recognition and reward, and intrinsic satis- 
faction more difficult. 

c) for the teacher compulsory attendance of students and a 
^ op cit. , Page 12 
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heavy schedule make positive motivation difficult, 
d) for the learner, compulsory attendance calls into question 



any internally motivated desire to learn. 



4 . 



Problems of school adaptation to environment 



a) so many conflicting pressures are brought to bear on 
the local school from so many sources that a sense of 
being particularly vulnerable and therefore especially 
defensive is quite common. In addition methods or ac- 
cepting outside influence are relatively undeveloped. 



b) 



factors of law, finance, and geographical districting 
create an essentially non-competitive stance for the 
school: it will continue to exist within a very wide 
range of actual performance outcomes. 

c) social change outside schools is more rapid and ex- 
tensive than it ever has been in this country. Schools 
are affected by this in terms of change in school 
population, subject matter, and change in other 
political, economic and social subsystems. The 

need to adapt appropriately is being radically accentua e , 

and minimally met. 

d) the child becomes a focus for much of the frustration 
•which "uncontrolled" non-understood rapid change 
produces. The child naturally responds to these 
multiple and conflicting pressures in a variety of no 
efficient ways, in terms of learning. 



C. School Problem Symptoms 



1 . 



Goal problems 

a) there is a tendency for decision goals to be ideologically 
rather than empirically based. 

b) value conflict often arises internally as a result of the 
schools' self-perceived role as transmitter of ide 
culture in the midst of actual evidence to different 

value positions. 

c) financial rather than cost-effective measures are often 
used as justification criteria,. 
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2. Task function problems 

a) procedural rigidity is often maintained as a hedge against 
unplanned change, and becomes a barrier to planned 
innovation. 

b) only 1 out of every 300 school districts in the country 
has overt capacity for systematic research. Probably 
only 12 districts in the entire country have what 
could be properly called a research and development 
unit to develop, test, and aid in implementing planned 
needed change. 

c) vulnerability, role diffusion, and real work overload 
supports widespread administrative inefficiency regard- 
less of the skills and intent of individual administrators. 

d) there is proven self-selection for teacher role of more 
passive, more deferent, less competitive personality 
constellations. This coupled with tenure systems in 
most school districts is a significant constraint to 
change . 

e) continuing questions of competency between teachers 
and administrators lead to a classic struggle between 
"experts" which is generally unresolvable except by 
the overt or covert exercise of raw power. 

3. Interpersonal Maintenance Problems 

a) morale problems are endemic to schools and hard to 
combat. Covert negative sentiments are not system 
constructive . 

b) the structure of the school promotes intergroup conflict: 
between grades, elementary, junior and senior high, 

at all levels. 

c) little systematic and extensive in-service training is done 
in most schools. 

4. Failure to Adapt Problems 

a) system vulnerability tends to produce passivity rather 
than initiative in response to conflicting forces. 

b) rationalized defense of existing policies and procedures 
is frequent and extensive 

c) relationships with parents are often strained and dis- 
ruptive because of the volatile dynamics of the parent- 
child subsystem. 

The above "catalog" is both formidable and compelling. It 
documents the need for carefully planned change and indicates the need 
for widespread participation in change. 

If you have read this far and are now interested in the degree to 
which the use of this planbook might serve you, and what style of 
implementation might be most appropriate, turn to the Memorandum 
on the next page and then take the questionnaire (A) which follows it. 
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TO: The Principal 

FROM: Project Self- Renewal Planbook 

SUBJECT: Is Operation Self-Renewal Relevant to Your School? 



It will take time and energy to use this Planbook. The Planbook is 
a tool designed to assist you in promoting rational and meaningful change 
in your school. The principle goal of such change is to produce mea- 
surable gains in student achievement. 

But you are a busy man. 

Rather than ask you to spend further time reviewing this planbook 
in detail, a questionnaire has been designed which will take 10 to 15 
minutes at the most. The results of this questionnaire will help you 
decide whether it is worth your while to spend more time on Operation 
Self-Renewal. 

If you are so inclined, you may want to call in a few administrative 
and teaching staff members (perhaps even a bright student or two) to 
take this questionnaire with you. If so, you will find six extra copies 
in the supplementary Operation Self-Renewal Work Kit. 

If you do invite others to participate now, it would be appropriate to 
let them know in advance that you are: 

1) only looking for a range of response, 

2) seeking counsel before you make a decision, or 

3) asking them to share in the decision whether or not 

to go ahead with Operation Self- Renewal. 

* 

Remember, you are in fact the key decision-maker in your school! 
(Though it may not always seem so in practice. ) That makes you the 
the central agent for meaningful change. Operation Self-Renewal can 
help you fulfill that privileged responsibility. 
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Questionnaire - A 



IS OPERATION SELF-RENEWAL RELEVANT TO THIS SCHOOL? 

. ? 
1 

Assumptions ; relevance here means the feasibility of meaningful change 
in your school. Meaningful change is defined as those changes which 
will lead to improved attitudes, increased cooperation, better use of 
human and material resources, wider and deeper shared sense of satis- 
faction -- all directed to measurable gains in student achievement both 
in and after leaving school. 



Directions ; 1) Put a check mark in the appropriate box after each statement: 

yes- 

no- 

unsure 

2) If you feel particularly strongly use two check marks 



o 
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3) When you have completed, turn to the scoring pages and 
follow the scoring instructions. 



1. We can hardly keep up with the work we have to do now, much less 

fill out any more forms !. — > 



2. There are a number of things which could be changed in this 
school to make it more effective r — 



This is especially true in areas of: 

a) teaching 

b) administration 

. c) additional funds 
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d) plant facilities 

e) curriculum 

f) teaching aids 

g) BIA support & policies 

h) guidance and counselling 



lalrin Scoring Page and go to A3 



mmmm 



HUBS 
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Questionnaire A -- SCORING SHEET 



- DR -A2 



Directions : Each statement is weighted on a scale of from -10 to 10. 
The factor in each case has been developed from experiential analysis 
of those forces which in fact promote or retard the planning and imple 
mentation of meaningful change. 

Multiply the factor for each statement by: 



•> +1 each yes 
- 1 each no 
0 unsure 



+2 or -2 double chk- 
(remember ! a minus x minus = +) 

Then enter the result in 
the score column 

Final scoring procedures and their interpretation will be found 
at the end of the scoring sheet. 
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3. Meaningful change can be brought about only if there is more money 
available. 



f 
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4. We would like to make meaningful changes, but any attempt is likely 
to fail because resistance to change is so great among;' 

a) teachers 

b) students 

c) BIA 

d) parents 

e) community at large 



5. Everything is just fine the way it is. 

6. We are glad to have visitors come and see what we are doing here. 

7. The students here are innately limited in their intellectual capacity. 

8. If there were realistic options, I would leave this school rather than 
let things go on the way they are. 

9. I would welcome a process that would allow rational participation 
of the entire school community in developing projects, that might 
lead to meaningful change. 



10. There could be a better use of current funds if new priorities could 
could be established and accepted by; a) staff 

b) teachers 

c) parents 

• d) students 
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11. It’s solely up to the principal to initiate and carry through change. 
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0SR-Q-A5 

While it is the functional responsibility of the principal to initiate 
and sustain change activity, to effect significant and lasting gains he 
must have the cooperation and involvement of: 



a) community leaders 

b) parents 

c) students 



d) staff 

e) teachers 



f) BIA 



Go back to A2 and begin scoring, 
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:nterpretation of scores 

•'ART 1) Should we proceed with Operation Self-Renewal? 

If a group, rather than an individual has taken this questionnaire, 
and that group is responsible for deciding whether or not to implement 
Project Self-Renewal, average total scores. 

b) Score above 150 : proceed with Operation Self -Renewal. If your 
observations approximate the reality of dynamics in your school 
and you follow the process laid out in the Planbook carefully you 
can be reasonably certain that meaningful change will come about. 

c) Score between 25 and 150 ; proceed with caution! Review the Planbook 
carefully. Have others take this questionnaire. It maybe that 
objective and attitudinal factors will seriously compromise efforts 

at meaningful change. 

d) Score below 25 : It is probably wise to abandon an attempt (at least 

right now) to implement Operation Self-Renewal. Fill out the OSR 

FEEDBACK QUESTIONNAIRE (example on page 16 , work copies 

in the Work Kit) and mail back with the unu_sed por.tiorL.QSR PACKAGES. 

Go to A7 if your score was above 25j-> 
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PART 2 If we decide to go ahead with Operation Self-Renewal, who should 
be involved? 



Enter your scores from the following questions: 
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a) If your sub-score is above 40 you will want to involve the entire school 

• 4 

community, and consider adding parents and community leaders. 

b) If your sub-score is between 0 and 40, you may want to choose a rep- 
resentative group from the various school constituencies. 

c) If your sub-score is between 0 and -40, you will want to proceed with 

just the principal and perhaps a few carefully chosen staff and teachers. 

15-24 
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OSR FEEDBACK QUESTIONNAIRE 



Part A 

I. If you decide to discontinue OSR, check the following: 
discontinued because -- 

Insufficient time Insufficient interest 

On the basis of Principal's score Ques. A 

Score 

On the basis of reviewer's score Ques. A 

Average Score 

On the basis of STEP 2 process 

If the last, describe briefly the factors which were 
discussed with reviewers that lead to the decision 
to discontinue: 



II. Please check if any of the following apply to your decision 
to discontinue. 



In my judgment, "Operation Self -Renewal Planbook" is: 



Irrelevant Should be abandoned 

Unclear Would be ineffective 



Inadequate 

Impossible to 
implement 

Too detailed 

Confusing 

Not detailed 
enough 

Would be too 
costly 

Should be re- 
vised 



Would be too time- 
consuming 

Would raise false 
hopes 

I would never use this 
kind of instrument 

Would be disruptive 

I would use this kind 
of instrument at 

some time 

* 

Other 



III. I have the following comments about OSR Planbook: 



(use back of sheet if necessary) 
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Part B 

I. If not completed to the end: 

a. Completed through STEP 

b. Reason for discontinuing: 



c. Judgment about OSR Planbook: Check Part A -II as appropriate. 

d. Suggestions: 



II. If completed to the end: 

a. Overall judgment of effectiveness on 0-100 scale: 

b. Suggested changes and revision: 



c. 

d. 



Attach summary of project descriptions, revisions, discontinua 
tion or adaptation, and cost in dollars. 



Has there been a measurable change in: 



Student achievement yes 



no 



If so, how much? 

(Aggregate Grade Change) 
Student satisfaction yes no 

'If so, how do you know? decreased incidence of 

negative behavior 

increased perception of 

satisfaction 
expressed 



Teacher and staff satisfaction 
If so, How do you know? 



yes no 

decreased incidence of 
negative behavior 
increased perception of 
satisfaction 
expressed 
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AN OVERVIEW OF THE MECHANICS OF OSR 



The OSR Planbook is comprehensive in scope and detail, much 
as an instruction manual for assembling a hi-fi kit. You are urged to 
adapt the material to your own needs and prior planning experience. It 
is hoped that you will share your experience and suggestions as you use 
these materials, since the Planbook must be subject to the same renewing 
and refining process it sets forth. To this end, five copies of an OSR 
FEEDBACK QUESTIONNAIRE have been included in the Work Kit at the 
end of the Planbook to be used as needed and indicated during Step 1, ' 

Step 2, or after Step 12. 

A number of pages in this Planbook are models you can reproduce 

as appropriate. Additional copies of any of the materials are available 
on request. 

Operation Self-Renewal is essentially a process for systematically 
determining the perceived needs in your school, sorting them, developing 
remedial projects, pilot testing those projects, evaluating the results, and 
making changes - all within the appropriate allocation of scarce resources: 
money, time, space, personnel, and materials. 

Because OSR is a process it can be broken down into task modules 
which lend themselves to the shorthand of flow charts, both verbal and 
graphic. On page 24 i s the OSR master PROCESS PATTERN flow chart 
which lays out the twelve steps to be taken in implementing OSR. 

The twelve steps are evenly divided into three phases: PREPAR- 
ATION, DEVELOPMENT, and ACTION: 

PHASE I - PREPARATION 

This phase entails a review of the Planbook, the decision to use 
it, the adaptation of the Planbook to your particular needs, and the 
presentation of the purpose and procedure of Operation Self-Renewal to 
your school. 

PHASE II - DEVELOPMENT 

t 

This phase is concerned with discovering and refining concerns, 
identifying or inventing feasible project remedies for those concerns, and 
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developing project priorities which offer the best likelihood of producing 
needed change in light of costs, benefits, and constraints. 

PHASE III - ACTION 

This final phase includes the decision as to which projects will 
be begun and when. It provides for a means of evaluating and revising 
projects under way, and finally, whether a project should be continued, 
revised, or dropped from full integration into your regular school pro- 
gram. The Planbook then cycles back to the beginning of Phase II for 
continuing self -renewal. 

WHO SHOULD BE INVOLVED IN OSR? 

The answer to this question depends on a number of factors: 
the size of your school, the amount of time you are committing for the 
implementation of OSR, and the level of involvement you are able to 
manage. Your subscore and its interpretation on page 15 will give you 
an indication with regard to the last factor. 

The OSR PROCESS PATTERN master flow chart shown here rep- 
resents the median involvement of a school community. Time and 
school population constraints will make its use appropriate in a majority 
of schools. By median involvement is meant a representative cross- 
section of administrative staff, teachers, and students. 

Two principal administrative structures are recommended for 

implementing OSR: 

1) The School Renewal Council [SRC]: This group should be 

representative and for the sake of effective operation should not 
exceed seven: 2 staff, 2 teachers, 2 students; or 3 staff and 
teachers and 3 students; in either case the Principal (or Super- 
intendent where appropriate) should serve as the 7th member as 
chairman. The SRC can be chosen by principal appointment, by 
self -nomination and appointment, by elected* slate and appointment 
by direct election, or by any mix of these methods. The authority 
and responsibility of the SRC should be defined in advance by the 
Principal, for it is this group that will do much of the work and 












attitudes of its members toward the Self-Renewal process will 
be a critical factor for success. 

2) The OSR Manager : This can be a staff member, a secretary, 

a teacher, a student. The OSR Managers function is to arrange 
schedules, see that questionnaires and other materials are ready, 
keep the Project Log up-to-date and generally keep the mechanical 
aspects of OSR running smoothly. 

If a less complex structure is desirable for whatever reason, the 
Principal can act as a one man SRC, using the OSR Concerns Inventory 
Questionnaires with a few selected and presumably representative 
community members. 

In a very large school it may be appropriate to have each class 
elect 4 or 5 class members to a School Renewal Forum so that the 
giving of questionnaires and tabulating results can be sharply streamlined. 

It should be cautioned, however, that any streamlining for 
efficiency's sake that excludes a significant number of community members 
from participation, may seriously reduce the liklihood of acceptance of 
projects . 

‘ . WHAT GRADE LEVELS SHOULD BE INVOLVED? 

It is recommended that OSR include from 4th or 5th grade up. 

It may be desirable to have a modified OSR Concerns Inventory Question- 
naire administered orally to younger students, preferably by someone 
other than their teacher. 

Decisions in this area are clearly dependent on the dynamics of 
your own school. 

WHAT IS THE BEST WAY TO SCHEDULE OSR? 

Scheduling decisions should be made carefully and early. It is 
better to take a bit too long, than to allow too little time for the self- 
renewal process. On the next page is an example OSR Preparatio n 
a nd Development Log which will be a helpful scheduling device. 

It provides space for both an estimated and actual time expenditure for 
Steps 1-8 of OSR so that experience will make future scheduling more 
realistic. A blank master copy of the OSR Preparation and Development 
Log will be found in the Work Kit, 
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SOME STYLE NOTES ON IMPLEMENTING OSR 



The style employed in implementing meaningful change is a 
critical factor in the success of that change. The following ground-rules 
should be adhered to as closely as possible: 

1) The purpose and procedure of Operation Self-Renewal must 

be fully understood by all participants involved in each step in the renew- 
al process. Do not rush the PREPARATION PHASE (I). The time you 
spend in careful "tooling-up" will be repaid in the level of commitment 
and energy which participants will be willing to spend, 

2) Guarantees of absolute anonimity must be stressed, especially 
to students by their teachers who will be administering the various 
questionnaires to them. A breach of this ground- rule will have severe 
adverse effect on the quality of the data. 

3) Members of the Self Renewal Council will be most effective 

if a climate of trust and acceptance of differences of opinion is explicitly 
established. 

4) Care should be taken to follow through on OSR once it is 
begun. Unfulfilled expectation of change can be very damaging to school 
community morale. 

5) Feedback processes are critical to the success of a meaningful 
change effort. It would be well to establish early regular communication 
on the progress of OSR: a "Self-Renewal Bulletin" at bi-weekly inter- 
vals, appropriate assemblies, announcements via teachers - are all 
viable as communication strategies. Whatever you choose to do in this 
regard, remember, people want and need to know what is happening as a 
result of their work, their opinions, and suggestions. 

6) It is absolutely essential that both the Principal and OSR 
Manager keep one STEP ahead in detailed familiarity with materials and 
mechanics.' 
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OPERATION SELF-RENEWAL MASTER FLOW CHART 



On the next page is the Operation Self-Renewal master flow chart. 

It is important that you understand the sequence and scope of events involved 
in carrying out Operation Self-Renewal before you begin to implement it. 

If you are uncertain what is involved in each step refer to the detailed 
description of that step (see table of contents for location). 

You will note that there are two opportunities to "discontinue" use 
of this planbook: in step 1 and in step 2. 

When you have familiarized yourself with the over -all process of 
OSR turn to page 25 , STEP 1 and begin. 
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STEP 1 

Even if you are convinced that you should use Operation Self-Renewal 
Planbook, the following is suggested (approximate time needed - 1 hour): 

1) Review STEP1 flowchart on page 27 . 

2) Fill in estimated time for completion of STEP 1 OSR P &c D LOG. 

3) Call in three to six people whose judgment you trust: (e. g. , a 

teacher, a staff member, a student). 

4) Briefly explain the purpose of OSR and ask them to take 
Questionnaire A. 

5) Have your secretary score the questionnaires. 

6) While the questionnaires are being scored, discuss the possible 
need and likely support for a planned process pointed toward 
meaningful change. 

7) Review scores: do they support your judgment? If not, in what 
way do they differ ? 

8) If the results are negative, and you decide not to continue, fill 
out the OSR FEEDBACK QUESTIONNAIRE*and mail back with 
unused portion of the OSR PACKAGE. 

9) If the results are positive, hand out copies of OSR Planbook to 
the group assembled and ask them to review it in detail. (The 
following materials have been deleted in the working copies of 
the Planbook: you are free to delete additional material you 
may consider inappropriate. ) 

10) Set a time and plan for getting together to complete STEP 2. It 
is suggested that you let no more than three days elapse before 
getting together again. 

11) The next meeting will take about an hour. A possible agenda is 
shown on the next page. You may want to hand this agenda out 
at the close of this meeting. Six copies are included in the 
Work-Kit. 

* Part A -- see copies in Work Kit 

.(*# See page 7, Volume IV - NOTE) 
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POSSIBLE STEP 2 REVIEWERS MEETING AGENDA 

Suggested length of meeting: 1 hour. 

Chairman: The Principal. 

1. Reviewers' reaction to OPERATION SELF-RENEWAL PLANBOOK. 

2. Consideration of amount of time OSR is likely to require. 

3. Consideration of actual costs involved in implementing OSR: 

a) Staff and Teacher time 

b) Student time 

c) materials costs 

d) other 

4. Discussion of possible effect of OSR 

a) on Staff 

b) on Teachers 

c) on Students 

d) on Parents and community 

e) others 

5. Recommendation of reviewers to the Principal: use or not use OSR 
Planbook? 

6. Reviewers return Planbooks to Principal. 

7. Adjourn. 
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OSR PROCESS PATTERN 



PREPARE 



STEP 1 



What: 



I 

I 

I 



1 



Review OSR Planbook 



Planbook 



This group 

-iprinc.inal Splectsk £ ake 3 <l uestion ' 
' i i^nncipai oeiectsj / n A n 









Score 

results 

— r~ 



Positive : 
Review Plan-’ 
book 



Negative: 



Fill out and 
mail OSR 
Feedback 
Questionnaire 



} Discontinue 
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STEP 2 



STEP 2 is the last opportunity to weigh the appropriateness of using 
the Planbook in your school. When you proceed to STEP 3 you are com- 
miting yourself to a process which will take time and energy, and which 
will raise expectations which can only be met effectively by the initiation 
of change projects and the incorporation of those projects which succeed 
into normal school life. Review STEP 2 Flowchart on page 31. 

1) Meet with the reviewers at the appointed time and place. 

2) Follow through on the STEP 2 Meeting Agenda provided, or your 
modification of it. 

3) Consider the recommendation of the reviewers and make a 
decision. 

4) If the decision is negative, fill out the OSR FEEDBACK 
QUESTIONNAIRE and mail back with the unused portion of the 
OSR PACKAGE. 

5) If positive, make the following decisions: 

a) Size, composition, and manner of selection of the School 
Renewal Council (see p. 19 ). 

b) Who the OSR Manager will be (see p. 20 ). 

c) What grade level of students will be involved (see p.20 ). 

, d) What the estimated schedule to complete through STEP 4 will 

be (fill in estimated time on OSR P&D LOG). (See p.20 .) 
e) What feedback process you will employ: "Self-Renewal 

Bulletin? " How often? By whom? Date of Assembly to 
present OSR to school? Announcements at regular inter- 
vals by teachers? (See p.22 , item 5. ) 

6) Implement the following: 

a) Call in designated OSR Manager and familiarize with OSR. 

Have Manager proceed with: process for establishing SRC; ' 
short announcement to community about OSR and SRC 
selection process; preparing to keep OSR P&D LOG up-to-date. 
(Fill in actual time STEPS 1 and 2. ) 
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b) Establish meeting time and place for first SRC meeting. 

c) Review agenda for first SRC meeting (possible agenda next 
page). Have OSR Manager distribute final agenda to SRC 
members after their selection. 
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POSSIBLE STEP 3 SRC FIRST MEETING AGENDA 



Suggested length of meeting: 11/2 hours. 

Chairman: The Principal 

1. Introduction of OSR to SRC members: by Principal. 

a) need for change process 

b) reviewers meeting results 

c) mechanics of OSR 

d) Ground Rules (see p. 21 ) ; anonimity, cooperative climate, 
follow-through, feedback. 

2. Rules of Order for SRC meetings. 

a) chairman 

b) order of agenda 

c) recording meeting results 

d) notification of future meeting agenda, place, time 

e) other 

3. Review Concerns Inventory Questionnaire #j_ f (CIQ #1). 

4. Adapt CIQ #1 to your school. 

5. Preliminary discussion of timing and approach to presenting 

OSR to school. 

6. Establish time of next SRC meeting. 

7. Adjourn. 
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OSR PROCESS PATTERN 



PREPARE 
STEP 2 



Who: v 

1 -Jl 



Principal 



1- 



What: 



A 



V 

I 

1 

I 

_L 



Decide to use Planbook 



v Weigh cost: 
^time & money 



Establish 
School Rene- 
wal Council 
/TC 



Consider 
judgment of 
reviewers 





l„. t 






V 


L 





^Decide to us€ r- 




Decide not 
to use 



4k 



Final deter- 
mination of 
organization 
al structure 



Fill out k 
mail OSR 
Feedback 



Select OSR 
"Manager " 



Que stionnaire ) Discontinue 
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STEP 3 




STEP 3 introduces OSR to the group (SRC) that will be the principal 
instrument for adapting OSR to your particular school and will act as the 
representative resource in carrying it out. It is a critical STEP and 
should entail careful preparation. Make certain that the SRC understands 
both the purpose and procedures of OSR before proceeding to STEP 4. 
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1) Review STEP 3 flowchart on page 37 . 

2) Develop your own introduction to OSR. Give examples of the 

\ 

need for meaningful change from your school situation. Relate 
who reviewed OSR Planbook and the results of their taking 
Questionnaire A. (This maybe written or oral preparation. ) 

3) Distribute copies of OSR master flow chart (from Work Kit) as 
you go over mechanics of OSR at the SRC meeting. 

4) Go over Ground Rules carefully and make sure their importance 
is understood. You may want to prepare your own version of 

OSR Ground Rules for distribution to the SRC. 

5) Determine the following with respect to Rules of Order for SRC 
Meetings: 

a. Chairman: you may want to remain as chairman of 

of the SRC, however you may be more effective if you 
let a teacher or staff member who is competent at 
handling group process serve this function on a permanent 
or rotating basis. 

b. order of agenda: could be traditional (i. e. minutes, 

old business, new business, etc.) or functional - order 
established by agenda. 

c. recording meeting results: it is suggested that the OSR 

Manager be secretary for SRC meetings, or at least be 
responsible for editing and distributing minutes. It maybe 
wise to keep a "tape" record of meetings. 

d. notification of future meeting agenda, place, time: a regular- 
ized agreeable process should be adopted for these house- 
keeping details. 

6) Review the Concerns Inventory Questionnaire # 1 - Part I (p. 34)and 
prepare sufficient copies for SRC in the form which you determine 
would be most effective as a "draft. " (There are 10 in Work Kit). 
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7) Prepare to lead preliminary discussion of timing and approach 
to presenting OSR to school. If yours is a large school and you 
have decided to use an OSR Forum (representative group), decide 
whether you or the SRC will determine how the Forum group is to 
be chosen. 

8) Proceed with SRC meeting. Distribute Agenda for next meeting (p.36 ). 

9) After meeting establish with OSR Manager schedule for completing 
CIQ #1. 
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Qu e fs tionnaire # 1 - Part I 



OPERATION SELF - RENEWAL CONCERNS INVENTORY 

Everybody has an opinion about everything that goes on in this school. 
This questionnaire is designed to put your opinions to work in helping to 
make this a better school. If we combine our skills, our knowledge, and 
our concerns we should be able to decide what changes are most impor- 
tant to us as students, teachers, administrators — and then we can develop 
projects which will help ..bring about those changes. ' . , 

This questionnaire will assist in identifying those areas of school 
life where change is needed and possible. Part II of this questionnaire 
will be handed out in a week or so and you will then be able to say what 
kind of changes you think are needed. 

Instructions: 

1. In the box up in the right hand corner of this page: 

a. if you are a student put an_S and your grade level (for example 

S6 if you are a student ii the 6th grade, Sll if you are a high 
school junior. 

b. If you are a teacher, use a capital T. 

c. If you are on the administrative staff, use a capital A. 

2. Please respond to the questionnaire as honestly as possible. 

No attempt will be made to discover individual opinions. We are 
interested in the total opinion of members of this school community. 

3. Now go through each of the categories below: the first box provides 

an opportunity to indicate how serious you think the problem is - 
one check = somewhat serious, two checks = quite serious, three 
checks = very serious; the second box indicates the direction you 
think change ought to take — more or better = a + mark, less or 
different = a - mark. 



A. Change in the classroom 



textbooks 
grades 
homework 
independent study 



x/ 


+or- 
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independent projects 
group projects 
field, trips 

teachers work harder 
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student’s work harder 

courses in: 

reading 

spelling 

writing 

arithmetic 

language 

job training 

pre -professional 

science 

social studies 

history of your people 

public speaking 

art 

drama 

music 



n/ 


+or * 



























































group discussions 
library work 
classroom furniture 
teacher understanding of: 
Indian language 
Indian culture 
Indian history 
teacher lectures 
student lectures 
guest speakers 
outside readings 

other* 



B. Change in the non-classroom environment 



>/ 


+or- 







































sports 

class schedules 

extracurricular activities 
like clubs, etc. 

school equipment 

counseling for jobs 

help with personal problems 

counselling for college 

maintenance of buildings 

food 





+or- 































parent involvment 
school rules 
school buildings 

school transportation 
health services 
other: 



C. Change in the dormitories (for boarding school students only) 



v/ 


+or- 
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supervision 

hours 

dormitory buildings 
available snacks 






+or- 



























after school recreation 
dormitory rules 
other: 










POSSIBLE STEP 4 SRC SECOND MEETING AGENDA 



Suggested length of meeting: 1 hour, recess, 1 hour. 

1. Discuss best way of presenting OSR to school: 

a. Purpose of OSR: what it can and cannot do for school 

b. How OSR will work: time schedule, mechanics, way in which 

school members will be involved. 

2. Select OSR Assemble sub -committee to report back to SRC within 

a week. 

3. Recess until time of sub-committee report, 

4. OSR Assembly sub- committee report. 

5. Final determination of method and time of presentation. 

6. Establish time for next meeting. 

7. Receive Agenda STEP 5 meeting. 

8. Adjourn. 
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STEP 4 

STEP 4 introduces OSR to your entire school. It is important that 
the plan you and the SRC develop pay attention to the method of pre- 
sentation as well as the content. An uninteresting assembly will hardly 
elicit enthusiastic support and participation. 

1. Review STEP 4 flow chart on page 41. 

2. Review possible STEP 5A SRC meeting agenda (page 39)* 

revise, and give to OSR Manager to prepare for distri- 
bution before adjournment of STEP 4 meeting. 

3. Give data reduction instruction sheet (page 40) to OSR 

Manager to prepare for compiling Questionnaire #1- 
Part I results. 

4. Meet with SRC - follow STEP 4 meeting agenda. 
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POSSIBLE STEP 5 MEETING AGENDA 
Suggested length of meeting: 1-1/2 hours 

1. Consider results of Questionnaire #1-Part I as presented by 
OSR Manager. 

2. Suggest appropriate form of Questionnaire #1-Par‘t II. 

3. Set time for giving of Part II. 

4. Establish time for next meeting. 

5. Adjourn. 
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DATA REUDCTION INSTRUCTION SHEET 

1. Use a blank Questionnaire #1-Part I to compile number of checks 
that are plus and number of checks that are minus for each box, 
counting each check as one. 

2. Prepare a report in which you rank order the major categories 

(A - Classroom, B - Non- Class room, and C - Dormitories) in 
terms of which has the most total number of checks, to the least. 

3. Within each category rank order each item from the most number 

of checks to the least, indicating the total number of plus checks 
and the number of minus checks for each. 










40-49 

0 



HtftUMOllHaMMMIMl 



i ajgai BgaigfcMM 




jiM viihipw 



11,4, 1 1H. I M \ B J ■ , I U| J [ I M UillW m. I ^ 







OSR PROCESS PATTERN 
PREPARE 
STEP 4 
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J | to 5 
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What: 



■> 



Choose approach 



Present to School 



Content: Why OSR im- 
portant, how OSR will 
\Jwork: time schedule & 
mechanics, how school 
members will partici- 
pate 



Method: Verbal? 
Written? Role Play? 
Skit? Assembly? Etc. 



Assign 

respon- 

sibility 



“?■ Present 
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STEP 5 

STEP 5 takes an inventory of concerns in two steps. The first 
step singles out which areas need changing the most, in the estimation 
of members of the school community. Then there is an opportunity to 
find out the nature of the concerns in detail. 

1. Review STEP 5 flow chart on page 47. 

2. Have OSR Manager give out Questionnaire #1-Part I as soon 

after the assembly as possible: copies to teachers for them 
to take and to give to their students, copies directly to 
administrative staff members. 

3. The OSR Manager: collect Part I within twenty- four hours of 
distribution, and tabulate results. • 

4. Review draft report with OSR Manager and develop final form 
which will inform SRC Committee. 

5. Develop draft form of Part II of Questionnaire #1 (see example 
on next pctge) and distribute prior to STEP 5 SRC meeting. 

6. Review STEP 6 meeting agenda (page 45), revise, ani give to 

OSR Manager to prepare for distribution before adjournment 
of STEP 5 meeting. 

7. Meet with SRC and follow STEP 5 agenda. 

8. Have OSR Manager proceed with Part II questionnaire. 

9. The OSR Manager: collect Part II within twenty-four hours 
of distribution, tabulate results in same fashion as Part I, 
summarize statements of problem concerns, and give draft 
report to Principal. 

10. Principal reviews draft, revises as appropriate and has dis- 
tributed to SRC with next item (see page 48). 

11. Review Questionnaire #2 development instructions (page 46) 
and produce draft to be attached and distributed with draft 
report of Part II results. 
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EXAMPLE 



Questionnaire #1 - Part II 



OPERATION SELF-RENEWAL CONCERNS INVENTORY 



This questionnaire is based on the results of Part I which you 
recently took. The way the three categories aid the items are laid out 
starting from the top represents the order of their importance in the * 
need for change. 

Instructions: 

1. Fill in the box above as you did Part I. 

2. Then respond to the material below as indicated: 



C. Change in the Dormitories : This is , is not , the most 



important area needing change in this school, 
a. Supervision : is too strict , too little 



, not fair 



not enough 



, other: 



Comments : 



b. Dormitory Buildings : are inadequate 

overcrowded , need to be decorated 



, too noisy 



, other 



Comments : 



A. Change in the Classroom: This is , is not 



, the most 



important area needing change in this school. 



a. Courses : needing change are: public speaking 
training , pre -professional . 



, job 



Comments : ' 



b. Textbooks: are not interesting , too difficult 



, worn 



out , don't teach useful things 

Comments : 
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B. Change in the non-classroom environment: This is , is not 

the most important area needing change in this school. 

a. Sports: we need more variety , less emphasis on 

competition , better equipment , more inter- 
school contests . 

Comments : 



b. Parent involvement: parents should know more about what we' re 

learning in school , parents should help out in the classroom 

and dormitories , parents should help with sports- 

events . 

Comments : 




Ad-**, 









iMMUi 










POSSIBLE STEP 6 SRC MEETING AGENDA 

Suggested length of meeting: 1-1/2 hours. 

1. Discuss report of Part II results. 

a. What are the real problems? 

b. Do the problems seem to be soluble in terms of possible 
projects? Costs? Energy of people available? 

c. What is the best way of stating the problem in terms of 

asking school community members to help identify or 
invent projects that would help solve areas of real 
concern. 

2. Discuss priority ranking 

a. Which problems are the most important? 

b. Which problems are likely to be able to be solved quickly? 

c. Develop a list in which the most important problems which 

can be solved immediately at minimum cost can be presented 
to the school community for their help in identifying project 
remedies . 

3. Adapt #2 Questionnaire for use. 

4. Receive Agenda STEP 7 meeting. 

5. Establish time for next meeting. 

6. Adjourn. 
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QUESTIONNAIRE # 2 DEVELOPMENT INSTRUCTIONS 

This questionnaire takes the form of a simple problem statement 
and space for project suggestions which will elicit creative response 
from members of the school community. An example is suggested below: 

OPERATION SELE-RENEWAL PROJECT SUGGESTION 



Priority Number: 3 

Problem Area: The class room- -need for public speaking course 
Problem Statement: 

A number of students and teachers suggested that one of the 
most important new courses needed is one in public speaking that 
will help students to express themselves better and give them 
increased self-confidence in front of groups. 

Project Suggestions: 



Questionnaire # 2 




Do you think there will be any cost involved 
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OSR PROCESS PATTERN 
DEVELOP 



STEP 5 






STEP 6 



STEP 6 focuses on narrowing down the concerns revealed in Part I 
and Part II of Questionnaire #1 into manageable form, developing a pri- 
ority ranking of concemor problem areas which seem soluble, and develop- 
ing a RENEWAL PROJECT SUGGESTION Questionnaire #2 for soliciting 

remedial project suggestions. 

1) Make sure when you are reviewing and consolidating 

Questionnaire #1, Part II, results that you give fair - ( 

representation to concerned criticism which you may 

find disquieting. 

2) Consider alternatives, constraints in terms of per - 
sonnel and dollars, possible benefits - in each prob- 
lem area so that you can take an active part in the 
discussion at STEP 6 SRC meeting. 

3) Review STEP 7 Meeting Agenda (page 49), revise, 
and give to OSR Manager to prepare for distribu- 
tion to SRC before adjournment of STEP 6 meeting. 

4) Meet with SRC and follow STEP 6 agenda. 
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POSSIBLE STEP 7 MEETING AGENDA 



Suggested length of meeting: 1-1/2 hours. 

1) Discuss report on RENEWAL PROJECT SUGGESTIONS received 
prior to meeting. 

2) Develop ranking of PROJECT SUGGESTIONS and combine similar 
suggestions. Discard those that are clearly impossible to carry 
out. 

3) Review and revise, if necessary, PROJECT DIAGNOSTIC SHEETS 
for use at next meeting. 

4) Receive Agenda STEP 8 meeting. 

5) Establish time for next meeting. 

6) Adjourn. 
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OSR PROCESS PATTERN 



DEVELOP 



STEP 6 




5 



What: 



I 



.L 



Assess Inventory Questionnaire 



Weigh result) 
Questionnaire-)-^, 
#1 - Par til I 



I 



What are 
the 

problems ? 



DO they 
seem 
soluble ? 



How should 
they be 
stated? 




Adapt #3. 
/Questionnaire 
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STEP 7 




STEP 7 takes project suggestions, collates them, refines them, 
and provides them with an initial priority ranking. 

1) Review STEP 7 Flowchart. 

2) Have OSR Manager prepare and distribute revised 
Questionnaire #2 - RENEWAL PROJECT SUGGESTIONS 
immediately after STEP 6 meeting. 

3) The OSR Manager should collect Questionnaire #2 within 
twenty-four hours of its distribution, do an initial sort 
and rank ordering and prepare a draft report for the 
Principal to review. 

4) Review and revise the draft report if necessary and have 
OSR Manager prepare copies for distribution to SRC mem- 
bers with the next item. 

5) Review the PROJECT DIAGNOSTIC SHEET (page 52-53), 
and have OSR Manager prepare copies for distribution 
with report of RENEWAL PROJECT SUGGESTIONS. 

6) Review STEP 8 meeting agenda (page 54), revise, and 
give to OSR Manager to prepare for distribution to SRC 
before adjournment of STEP 7 meeting. 

7) Meet with SRC and follow STEP 7 agendai 
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PROJECT DIAGNOSTIC SHEET 



Instructions : 

1. Enter value factor in Column 1, A and B. 

2 . If re-allocated funds, enter value factor in Column 2, A and B. 

3. Follow through steps indicated in C, 

4. Enter Cost-Effectiveness Index (CEI) inbox on next page. 



A. Problem Area 



1. Perceived need 

determine from location rank order 
list (top of list=10, bottom-0) 

B. Project Suggestion 

2. Constraints 

Assess constraints total on basis of 
consideration of real factors such 
as acceptability to extra -school 
authorities, staff, teachers, parents, 
community members, also time, 
space. 



3. Benefits from change 

a. Student achievement -anticipated 
likelihood that p^ .:jifcct v/ill materially 
affect student academic achievement, 
b. Student satisfaction-anticipated likeli- 



Value 
Factor (VF) 
Range 



0 to 10 



0 to -10 



0 to 1 0 x .7 



0 to 1 0 x .3 

hood of improvement in attitude of stude nts. 
c. Improved staff and teacher attitude and 
effectiveness 



4. Human Resources available 

Are there personnel available who will 
expend the energy, and have the skill to 
carry out the project. 



0 to 5 



0 to 5 



VF- 1 VF 
Proposed [ Lost 
Project I Service 



V factor total 
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C. Cost Efficiency Index (CEI) 
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1. Re -allocated funds 

a. If project were to be permanently adopted, 
what is likely to be cost per pupil served 

F factor = 

Z factor 

b. Multiply 1/F x V = 

c. To determine trade-off los s , develop V 1 
factor using column 2 for service being 
dropped by reallocation of funds. 

d. What is cost per pupil served of service 
being dropped? 

F* factor = 



t 



I 

$ 

i 
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e. Multiply 2/F 1 x V»* Z factor 

f. Z-Z 1 = CEI enter below 

2. New Funds 

a. Multiply F factor step C. l.a. above by 1.5 
if finds are available but unallocated 

N factor = 

b. Multiply: 1/F x N = CEI enter below 

c. Multiply F factor step C. l.a. by 4 if funds 
unavailable but possible to obtain 

N* factor = 

d. Multiply: 1/FxN' = CEI enter below 

Project CEI | 

. © 

» 

* • 

' * 
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POSSIBLE STEP 8 MEETING AGENDA 
Suggested length of meeting: as needed 

1) Develop a cost-effectiveness index for each proposed project. 

Rule out those that are clearly unfeasible. 

2) Develop. a priority ranking for all proposed projects. 

3) Receive ANNOUNCEMENT OF OSR PILOT PROJECT form for review. 

4) Receive Agenda STEP 9 meeting. 

5) Establish time for next meeting. 

6) Adjourn. 
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STEP 8 



STEP 8 is the most critical STEP in the entire process of Operation 
Self -Renewal. In it, change projects are scrutinized in terms of both needs, 
and real constraints such as time, space, available personnel, outside in- 
fluence, and most critical of all - available funds. 

1) Review STEP 8 Flowchart with care, (page 60) ' 

2) Review ANNOUNCEMENT OF OSR PILOT PROJECT form 
(pages 57-58), revise if necessary, and give to OSR Manager* 
to prepare for distribution at STEP 9 meeting. 

3) Review STEP 9 meeting agenda (page 59), revise, and give 
to OSR Manager to prepare for distribution to SRC before 
adjournment of STEP 8 meeting. 

4) Meet with SRC and follow STEP 8 agenda. 
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ANNOUNCEMENT OF OSR PILOT PROJECT 
PROJECT NAME 



DATE: 



PRIORITY NUMBER: ) 


STATUS: 


NEW 1 1 


1 REVISED L_J 


BEGIN DATE: 1 ] DURATION: 




REVIEW DATE: 






PROJECT COORDINATOR: 



WHO IS INVOLVED IN PROJECT? 
EXPECTED COST: 



SOURCE OF FUNDS: 



DESCRIPTION OF PROJECT: 




** FOR OFFICE USE ** 






RESULTS: Permanently Adopted? Yes | | No 




If no, because: 





ACTUAL COST: | . 

IF YES: Final Project Description as Adopted: 
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ANNOUNCEMENT OF RESULTS 
OFOSR PILOT PROJECT 



PROJECT NAME: 



DATE: 



PRIORITY NUMBER: 



DESCRIPTION: 



DROPPED BECAUSE: 



REVISED AS FOLLOWS: 



PERMANENTLY ADOPTED IN THE FOLLOWING FORM: 
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POSSIBLE STEP 9 MEETING AGENDA 



Suggested length of meeting: as needed 

1. Review and decide on final ANNOUNCEMENT OF OSR PILOT PROJECT 

form. 

2. Project by project, starting with highest CEI: 

a. Choose Project Coordinator. 

b. Develop project plan. 

c. Briefly reconsider cost, discuss and refine. 

d. Assign writing of final project description. 

e. Determine begin, review/revise, and final decision date on each 

project. 

3. Review overall state of Operation Self-Renewal in terms of the specific 

projects’ format. 

4. Make final determination on projects to be begun. 

5. Establish time for next meeting. 

6. Receive agenda STEP 10 meeting. 

7. Adjourn. 
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OSR PROCESS PATTERN 
DEVELOP 
STEP 8 
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STEP 9 



STEP 9 is the final stage in developing the "menu" of pilot projects 
to be implemented. 

1) Review STEP 9 Flowchart, (page 63) 

2) Determine if there are any projects which you will not 
entertain, and remove them from consideration. 

3) Consider possible Project Coordinators: may or may 
not be SRC members. Prior consultation with them 
may be appropriate. 

4) Review STEP 10 meeting agenda (page 62), revise, and 
give to OSR Manager to prepare for distribution to SRC 
before adjournment of STEP 9 meetings. 

5) Meet with SRC and follow STEP 9 agenda. 
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P OSSIBLE STEP 10 MEETING AGENDA 
Suggested length of meeting: 11/2 hours. 



1 . 

2. 

X 


Consider the problem of gaining cooperation from those who will be 1 

im 

affected project by project. 1 

Assign members of SRC to consult with those who can help to imple- • 1 

ment each project successfully. 1 


3. 

4. 

5. 

6. 
7. 


Determine how best to announce projects being implemented under 1 

OSR: assembly? written PROJECT ANNOUNCEMENTS? Bulletin? 
etc. * \ 

Establish time for next meeting. j 

Receive PROJECT FEEDBACK QUESTIONNAIRES for review. j 

\ 

Receive agenda STEP 11 meeting. 

| 

£ 

s 

Adjourn. j 
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OSR PROCESS PATTERN 





STEP 10 



STEP 10 is principally concerned with the strategy for introducing 
the implementation of OSR Projects. 

1) Review STEP 10 Flowchart, (page 67) 

2) Look over projects so you can take leadership in discussing 
implementation problems. 

3) Have OSR Manager develop draft PROJECT FEEDBACK 
QUESTIONNAIRES (see Page 65) which after you review 
can be prepared for distribution to the SRC end of STEP 10 
meeting. 

4) Review STEP 11 meeting agenda (page 66), revise, and 
give to OSR Manager to prepare for distribution to SRC 
before adjournment of STEP 10 meeting. 

5) Meet with SRC and follow STEP 10 meeting agenda. 
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DEVELOPING PILOT PROJECT FEEDBACK QUESTIONNAIRE 



This instrument should be designed to elicit honest and anonymous 
response to the effect of each project on all those involved. It should give 
them an opportunity to indicate that they wish the project: dropped, left 
as is, revised and further tested (with their suggestions for revision), 
continued further. 
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POSSIBLE STEP 11 MEETING AGENDA 



t 



Suggested length of meeting: as needed. 

1. Complete revision of PILOT PROJECT FEEDBACK QUESTIONNAIRES (PPFQ) 

for each project. 

2. Recess 

3. Review tabulated results of PPFQ with each Project Coordinator and 

take action as appropriate. 

4. Receive STEP 12 meeting agenda. 

5. Establish time for next meeting. 

6. Adjourn. 



66-75 



o 

ERIC 



jj 






jjBBgaBMjaaag gas 









OSR PROCESS PATTERN 



ACT 
STEP 10 







Implement OSR Projects 



Develop 


| — ) 


Appeal 






Consult those 


entry 




' 




-> 


who can help 


* stragegy 


— > 


Constraints 






implement 
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OSR Project 
Announcement: 
Goals and timing: 
start, review- 
revise, 

implementation- 
criteria for 
effectiveness 
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STEP 11 



STEP 11 involves a careful review of each project in terms of j 

i 

user reaction, for further revision and testing, dropping, or incorpora- | 

ting the pilot project into normal school processes. 1 

1. Review STEP 11 flow chart, (page 70) j 

2. Review STEP 12 meeting agenda (page 69), revise, and give j 

to OSR Manager to prepare for distribution to SRC before j 

adjournment of STEP 11 meeting. I 

3. Meet with SRC and follow STEP 11 agenda. j 
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POSSIBLE STEP 12 MEETING AGENDA 



I 



Suggested length of meeting: as needed. 

1. Take each project and see if it needs to be restated in long range 

terms. 

2. Using PROJECT DIAGNOSTIC SHEETS, recalculate CEI in terms. 

of actual experience (in C. l.e use 1/F'=V'). Include the Project 
Coordinator in these discussions. 

3. Determine whether permanent feedback monitoring process is needed, 

and make decision whether should be put into full integrated operation. 

4. When Project review and determination completed, review entire OSR 

operation; fill out and mail OPERATION SELF-RENEWAL FEEDBACK 
QUESTIONNAIRE; revise OSR process pattern and materials as 
needed. Establish schedule for next cycle of OSR. 

5. Adjourn. 
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OSR PROCESS PATTERN II 



£ 



ACT 






STEP 12 




STEP 12 completes this cycle of OSR. Each project is tested for 
its realistic cost-effectiveness after the trial period and a determination 
is made as to its disposition. 

1) Review STEP 12 Flowchart, (page 72) 

2) Have OSR Manager distribute OSR FEEDBACK QUESTION- 
NAIRES to members of SRC. 

3) Have OSR Manager prepare sufficient copies of the PROJECT 
DIAGNOSTIC SHEETS for the final meeting. 

4) Determine how final decisions are to be made on project dis- 



position and make this decision-making process clear in ad- 
vance of STEP 12 meeting. 



5) Meet with SRC and follow STEP 12 agenda. 
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OSR' PROCESS PATTERN II 



ACT 



STEP 12 



To 5 




To 5 






J. 



Put into Full Operation/Review OSR 



Meet needs? 






Consider [^Create constraints? 



What 



Restate pro- 
ject in long- 
range terms 



^Long term benefits? 

4 



Continuing eommit- 
ted personnel? 



Put into 
full operation 



Review 

OSR 



Permanent 
. feedback 
needed? 









Expected 

effectiveness 



-) Long term cost? 



L 

New 






Permanent 


fund s ? 




reallocated 


0 




fund s ? 



Trade-off 

loss? 



Revise 
OSR 
process 
pattern 
as needed, 
and materials 
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TOWARD A CONCEPTUAL 
ARCHITECTURE OF A 
SELF-RENEWING SCHOOL 

SYSTEM 

GOODWIN WATSON 
Director, Laboratory for 
Applied Behavioral Science 
Newark State College 
Union, New Jersey 



This paper presents an attempt to think through, systematically, the 
kind of school system which the Cooperative Project for Educational 
Development (COPED) envisions. It starts with basic social theory and 
develops concepts for the structure and processes needed to insure self- 
renewal. The concepts that emerge have considerable, relevance for the 
processes of consultation and intervention which will bring about this 
kind of system, but the focus here is on how the end-product will look 
and how it will operate. I 

l 

SYSTEM AND ROLE THEORY 

1. Every social system is composed of interlocking positions and inter- 
acting roles. Among the positions in a school system arc those of parent, 
board member, superintendent, principal, teacher, caretaker, and pupil. 
Each position requires role-performance in relation to what persons in 
other roles expect and do. 

2. Smaller systems are either loosely or more tightly integrated within 

larger social systems. Thus a single school is part of a city school system, 
and the city school system is itself part of county, state, and federal edu- 
cational operations. The schools are parts within other systems such as 
city government; economic and tax structures; and activities of state, 
national, and world organizations. When one part of a system changes, it 
produces strain at the interfaces of interaction with other parts until the 
other parts have adapted to the change. - . . . ’ 
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3. As roles interact within a subsystem, and as parts interact within 
larger systems, they are reciprocally modified toward a working equi- 
librium. Tire roles and parts do not change equally. Those lower in any 
hierarchy of power and prestige adapt-to-conform more than do the 
higher levels. Some parts of the culture, such as the ritualistic and sacred 
activities, change less than do others, notably the technological. 

4. Social systems tend to be stable and homeostatic; after minor dis- 
turbances they return to an equilibrium approximating their state before 
the unsetdement. A chronic disillusionment of reformers is that their 
success proves only temporary and has fewer good consequences than 
they expected. “Clean-up” campaigns in city politics or “new broom” 
effects of a new school superintendent illustrate the thesis. Some behav- 
ioral scientists argue that social systems arc only self-perpetuating; they 
question whether systems can ever become characteristically innovative, 
growing, and self-renewing. 

5. Social systems are generally hierarchical, with level of prestige, power, 
and responsibility. The higher-level roles are more satisfying to occupants 
and offer more freedom for self-actualization. Hence, need for change is 
less apparent to persons at or near the top of the system. 

Schools, in one respect, differ from most other hierarchical institutions. 
Teaching is a profession and teachers often are given a high degree of 
autonomy within their classrooms. They are less closely supervised by 
superiors than are factory operatives or sales clerks. 

Some innovations can easily be introduced by any teacher. The class- 
room, however, is a part of larger social systems which design the cur- 
riculum, the building, the working schedule, the assignment of pupils, the 
pay scales, the equipment, the forms of reporting, and many other factors 
conditioning the teaching process. The teacher commonly feels as help- 
less to influence these larger social systems as would a subordinate in any 
other large organization. 

6. The structures of a system largely determine the patterns of inter- 
action which take place within it; and these, in turn, form the attitudes 
of participants. This is the SPA sequence— from the situation (S) to the 
processes of social behavior (P) to the consequent attitudes (A). The 
habits, beliefs, and sentiments which arise within a system (religious, 
political, commercial, family) have been formed by experiences which 
have been shaped by the prevailing institutions. If a society be patriarch- 
ical, male-dominated, racially segregated, Moslem, and pastoral,, its 
structural characteristics will affect the behaviors of adults and children 
in ways which produce generally congruent attitudes. Even if some mem- 
bers find life unhappy, they are likely to believe that their particular 
culture is better than any other and that it cannot readily be changed. 
They live resigned, if not satisfied. 
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SOURCES. OF CHANGE 

7. While either internal or external forces or both together can effect 
change in a social system, the usual congruence of member attitudes with 
the traditional ways of operating (Thesis =£6) means that most change 
usually is initiated by outside impact rather than internal dissatisfaction. 
Racially segregated schools have been slow to change, even under the im- 
pact of Supreme Court edicts, the economic pressure of federal aid, and 
active movements for racial equality. Scientists and mathematicians may 
have been dissatisfied with public school' curricula and performance in 
these disciplines, but not until the first Sputnik symbolized a contest with 
the U.S.S.R. did the schools change their programs. 

8. The rapid advance of the scientific and technological sectors of our 
society creates stress on many interfaces where they impinge on slow- 
changing institutions. The impact on education has been manifold. 
Accelerating scientific advance has brought the “explosion of knowledge 
which forces revision of curricula. Technological changes have eliminated 
some traditional occupations and created demands for new kinds of 
training. Rapid communication and transportation have made the ethno- 
centric curriculum of American schools an anachronism. New opportuni- 
ties are presented to teachers by new media: films, projectors, tape- 
recorders, kinescopes, T.V. and closed circuit T.V., microfilm, com- 
puters, and other instruments. As technology has raised standards of 
living, it has also made college education economically possible for more 
pupils and has changed their secondary school demands. A more subtle 
influence arises from the conflict between prescientific and scientific 

methods of thought in certain areas of our culture, 

« 

•9. While internal change-influences are less potent than the contextual 
pressures, they are still important and occasionally become the main 
source of an innovation. Every participant in a social system experiences 
some conflict between his personal needs and the role-demands of his 
position in the system. When these become intense and shared by man) 
persons, they generate reforms or rebellions. No institution accords per- 
fectly with the values of its members. What seems to be inertia may be 
rather what Lewin has called a “quasi-stationary equilibrium” in which 
forces for and against a specific change are fairly evenly balanced. 
Change may be brought about either by increasing the forces favoring 
change or by decreasing the resistance to change. School board members, 
superintendents, curriculum specialists, supervisors, guidance counselors, 
principals, teachers, parents, custodians, and pupils would each welcome 
certain changes. They are apt not to express these desires for change. 
They may fear that frank presentation of dissatisfaction could threaten 
them with criticism, reprisal, or loss of position. They may distrust t ictr 
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own impluses (“Who am I to make suggestions to all these wise eapcr - 
cnced powerful others?”). They may suppose that their suggestions fo 
change will be interpreted as “rocking the boat” or •‘trouble-making or 
presumptuousness. Hence, there remains an unexpressed potential readi- 
STo change which can occasionally break through m surprising 
S monstrations 0 Because the discontent has not been open* a red and 
examined, it accumulates and emerges somet mes in bhnd, Parnate 

revolt. So long as the explosions are individual and isolated, > 

handles them by suppression or expulsion. In the rare *“ h t 

many individuals join together in a protest action, the system 

adapt. 



10. Most innovations come to be adopted through diffusion. °r. >na 
innovating person or institution must have responded to unusual pressures 
Sid opportunities. Later, others hear about the « ideas or programs 
Sociologists distinguish a two-step process by which a small » r ° u P 
“influentials” are the first to learn about the new project and 
transmitters to a wider circle. Lippitt has suggested that schoolsysteiTU 
are seriously deficient in transmission processes for new and lm pro 
wavs of working. Hundreds of successful classroom innovations are born 
toTloom unseen. Some get into journal articles, conversational report, 
or books-but many are unknown even to other teachers in 

On the receiving side of diffusion are the educators who “get around ,” 
who visit forward-looking school systems, take graduate courses, go o 
conventions and workshops, serve on committees, of national °^m za * 
tions. The “cosmopolites” hear about what is being done: . they spread 
the news and maybe try some of the borrowed innovations in their own 

schools. 



PREVAILING PATTERNS OF CHANGE 
IN SCHOOL SYSTEMS 



11. School buildings of the 1960’s are clearly different from those of fifty 
years ago. What goes on inside the buildings may or may not be as 
modern.. By and large, most changes have been introduced: 

(a) sporadically rather than continuously; 

(b) by outside pressure rather than generated from within the system 

itself; • 

(c) for expediency rather than as an expression of conviction or 

planning; % ' . , 

(d) one here, one there, rather than in a cumulative and integrated 

design; • , ’ 

(e) much later tha . desirable-lagging rather than leading; 
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(f) at a superficial level, rather than in the basic and fundamental 
educational, functions; 

(g) to bring kudos to certain ambitious individuals rather than to do 
the educational job better. 

12. Change has sometimes come so slowly that new educational institu- 
tions have arisen to meet the’ social needs. Traditional academies were 
replaced by modern secondary schools; youth-serving organizations arose 
to meet recreational needs the schools did not serve; junior colleges filled 
a gap not met by existing colleges; “classrooms in the factories” are 
doing an immense adult education service which schools could not take 
on; “head start” programs serve young children the schools were unready 
to assist. 

A DESIGN FOR CONTINUOUS SELF-RENEWAL 

The following ten steps are derived from analyses of the process of 
constructive thinking and problem solving: sensing, screening, diagnosing, 
inventing, weighing, deciding, introducing, operating, evaluating, and 
revising. Success at each step is partly a matter of cognitive clarity 
about the goal and appropriate methods of each process. Success depends 
also on emotional involvement, on skills which need to be developed, and 
on social structures which will encourage and sustain the desired attitudes. 
Each of the ten steps will be considered here in turn. The discussion of 
each step will close with a summary statement of the structural implica- 
tion of that step for the self-renewing school. 






1 



> 



I 




Sensing 



L Sensing is everyone’s business. Sensitivity to unmet needs in individuals, 
whether pupils or staff, and to changing social situations affecting educa- 
tion can never be adequate if it is seen as the duty of one man or a 
small group. Everyone involved in the schools is likely at some time to 
become aware of a need for improvement. One distinctive characteristic 
of a self-renewing school system is that there is constant and widespread 
sensing of problems and of ne\v possibilities. These are openly expressed, 
shared, and considered. In varying degrees, everyone listens to everyone • 
else. Participants feel free to talk about the things they think need 
improvement. 

While the general climate of openness and interpersonal trust is essen- 
tial to permit and encourage the bringing out of sensed difficulties, it 
is also important to delegate special responsibilities to some parts of the 
school system. Keeping up— witli scientific discovery and technological 
invention in emerging or waning. vocations; new trends in art, architec- 
ture, music, and literature; fresh problems and activities of government; ! 
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arid current efforts in other progressive school systems-is too large an 
order tb leave entirely to personnel busy with other jobs.' In many com- 
munities there are some citizens who make it their business to be up-to- 
date in one or another of these areas. Perhaps an advisory committee on 
emerging trends could enlist persons especially likely to be aware and in 

To supplement the free spontaneous expression of students, teachers, 
administrators, and parents, periodic surveys should be operated to- tcan^ 
the ran°-e of concerns which are important to good and better educauon. 
Special°attention needs to be paid to those lower in the hierarchy who 
have previously not felt much freedom to express their^ feelings. 

Structural implication: Mechanisms for “keeping up” with internal 
concerns and external trends and resources. 



Screening 



2. Not every trend in the larger society, and not every difficulty or frus- 
tration within school personnel, should lead to significant innovation : in 
the schools. Some order of importance and priority must be estabhshe 
so that the school system can go to work on its more urgent problems 
Too often, proposed improvements are concentrated in the areas in which 
it is easy for school people to operate (e.g., getting more upper-middle 
class pupils into college) and neglect the really tough situations. Fina 
responsibility for screening and setting priorities rests with the school 
board but a policy committee of staff and citizens to advise .he superin- 
tendent might also help to recommend wise selections. The mechanism 
required would be a tunneling of data from sensmg apparat, 
a preliminary screening and then to one or more bodies charged with 
responsibility for deciding whether the items merit further investigation. 

Structural implication: A. mechanism for setting problem priorities. 



Diagnosing 



3. This step, of critical importance in guiding constructive action is 
too often short-cut. It is one thing to be aware that many students lack 
intellectual curiosity; it is quite another to understand why. Too many 
students suspended” and “too few parents taking an interest in F.l.A. 
show needs for some attention, but do not represent a basis, yet, tor 
action proposals. A whole series of questions remain to be answered: 
Who? Where? When? How do the incorrigible students or uninterestLd 
parents differ from those who do respond to school activities. It is 
essential to hold back oh the common impluse to offer solutions until it 
is quite clear what the problem is and where it lies. 
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While everyone concerned can take some part in the movement from 
simple awareness that a problem exists toward defining and diagnosing 
the real trouble, again a self-renewing school system will have some 
agency especially devoted to this process. Probably it will take. the form 
of a “research and development” unit, with some full-time personnel. 
They will conduct some of the scanning operations mentioned here (step 
1), and they will move on to interpret the findings, .integrate them with 
other information, and collect new data which may help define more 

precisely the problem to be solved. _ 

A technique proved useful for better diagnosis is the “force-field 
analysis,” which identifies those forces moving toward a given end and 
those in opposition. If each vector in a “quasi-stationary equilibrium” is 
drawn long (to represent a major force) or short (to represent a minor 
force), the sum of vectors in each of the opposed directions should be 
about equal. Once the major forces resisting a particular improvement 
have been identified, the groundwork has been laid for thinking about 
effective action. 

Structural implication: Establishing a research and development unit. 




Inventing ___ 

4. When problems have been noted by a sensing process,, screened, and 
diagnosed, it is time to begin generating remedies. At this stage, brain- 
storming may be helpful, because, with initial evaluation suspended, all 
kinds of creative notions can get a hearing. This is a good opportunity 
to involve a wide range of persons, drawing upon a wealth of resources. 
Pupil groups of all ages, parents of both sexes, and various teaching, 
administrative, and community groups can be invited to contribute ideas. 
All start from essentially the same diagnosis of the problem, so the variety 
of reactions can be illuminating in understanding group and individual 
differences. 

Structural implication: Mechanisms for wide participation in the pro- 
duction of solution proposals. 



Weighing 



5. Weighing the numerous suggestions that emerge from brainstorming 
is the next step. Sometimes the groups that have been generating ideas 
can help, using the last part of their session to select four or five which 
seem best to them. Eventually, however, a small group— perhaps the 
Administrative Council, or a Research-Development Bureau— must ap- 
praise the proposals: What would happen if this or that or. the other 
were put into effect? It is useful, at this point, to distinguish factual 
questions from those of value and preference. Research can furnish 
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evidence on matters of fact; valu e questions cajl for an approach m winch 
' screening soiution proposals. 




6. The culmination of the choosing PfS^^j^nmcd problem. Those 
innovation or set of actions to cope wt => involved in making 

^ committed ’ 

" The^pproach to a true consensus U rather 

of decision which operates in P arba ” e " 7 P sec onded, debated, and 
procedure begins with a motion, which . then secon , fraction of 

voted upon, being decided y ma J® r ‘ ^ amendments to amendments, 
those voting. Often there are If a consensus is 

and a referral back to some com t 1 successive approximations. A 
desired, the process would better me objections; a second 

proposal is made; it receives : S ? m ‘ “„nt ofVe objections; this is still not 

formulation is attempted to take account of h^ ^ ^ objec . 

quite acceptable, so a third v ronC e S si 0 ns have been made and the 
tors are satisfied, but too many . vers ; on introduces some 

original supporters are unhappy; others. Through a series of 

reassurance for them, « bb ? u \^ed l a shape acceptabfe to all. This 
formulations, the proposal is ablsele ‘* P decisions for which the 

Often takes a long time, and *em .^y “ manyde^ ^ ^ 

Sts ( t« b^Tn^unt) will not be worth the time required 

‘° AkincT oTconsenstial process may operam a -^Xn they'feel 
decision is a true consensus P a [ 'Xn imo account. They recognize, 
strongly, their position will . Y . organization cooperation; 

however, that there can JVSZ** - Liston, which are no. 
and they are prepared to go along wl ^ reS pect and trust 

quite what they P« sonal ' y f "°“ a P C cord with the main objectives. _ 

Mianisms for participation of eventual im- 

plemcnters in the decision-making process. 



7. The next function is in.roduamn 
system. This requires some planning. Where. 
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the best start? When? Timing is part of good strategy. By whom? The 
names associated with an innovation can help or hurt it. 

A pilot project which can be gradually expanded is often a good 
approach. Sometimes, however, a change demands all-or-none adoption. 

Another strategy question concerns getting aboard those persons who 
have not yet been involved in the sensing, screening, diagnosing, weigh- 
ing, and deciding. There is likely to be resistance to a proposal which 
comes to them “out of the blue.” If the change is disturbing and im- 
portant, it may be necessary to conduct other groups of participants 
through some of the thinking process which led to the emergence and 
selection of the new project. 

Structural implication: Mechanisms for strategy planning. 



Operating 



8. Operating the innovation as a normal part of the system for a period 
of time can hardly be further specified, since so much depends on what 
the affected processes are. A moratorium on revision or rejection until the 
project has had a fair chance to prove itself may be in order. 



Evalua ting 

9. At the time when the innovation is designed, it should have had built 
into it procedures for recording what is done and evaluating the expected 
outcomes. Evaluation should be both continuous and periodic. It may be 
the responsibility of a research and development unit within the school 
system, or of a special subcommittee, or of an outside, impartial agency, 
or of some combination of these structures. A common error is to let 
evaluation be done by those conducting the operation. Their involvement 
in its success usually makes them less objective. 

Structural implication: A mechanism for objective evaluation. 



Revising 



10. Revising the innovation to take out any “bugs” and to improve its 
effectiveness calls really for a repetition of most of the steps listed in this 
section. Need for some revision must be sensed, screened, and diagnosed; 
proposals must be invented, weighed, chosen, and introduced. 

The apparatus of self-renewal— the mechanisms for internal and 
external sensing; the procedures for screening and diagnosis; the invent- 
ing, comparing, and selecting operations; the strategics of introduction, 
follow-through, and evaluation— itsfclf needs periodic review, appraisal, 
and revision. 
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Structural implication: Mechanisms for re-appraisal and revision of the 
system, its processes, and specific innovations. 

The structures and procedures outlined here may prove unduly foirnal 
and academic! Efficient and experienced persons discover , short-cuts 
which work as well or better under certain conditions. The self-renewmg 
school system will not give equal weight and attention to all changes. 
The full-scale, ten-step operation can be held in mind as a model, to be 
used when the innovation is truly momentous; approximations will be 
sufficient for many lesser problems. 
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EXERCISING TWO PROGRAMS THROUGH THE SCHOOL PROCESS MODEL 



While a much more complete exercise could be developed, for 
the purposes of this draft, two programs which well could have been 
generated by the use of Operation Self-Renewal Planbook have been chosen. 

One is an ambitious, high cost per pupil summer field trip 
program, which a student might well nomer ''Project Wide Horizon. " 

The other is a much more mundane response to the need for 
mono-sexual class arrangments expressed by many Indian children. 

What is shown on the following pages is simply the development 
of the Cost-Effectiveness Index by the use of the PROJECT DIAGNOSTIC 
SHEETS. This is the heart of the School Process Model in terms of 
developing priorities, and "teaching" a reality sense. This particular 
section will benefit considerably from field-testing the model. 

As will be seen, at this stage of Operation Self-Renewal (STEP 8), 
Project Solo is on the order of 120 times as potentially cost -effective as 
Project Wide Horizon. This does not necessarily mean the Solo should 
be adopted and Wide Horizon dropped. It does mean, however, that caution 
is dictated, and further analysis required. 
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* BIA EDUCATION PROGRAM DE SCRIPTION- 



jjia u wi l y^avjiur xiuiY 1 — — 

\ .*#»*• » • • 

Problem: To Eliminate Cultural Isolation and Geographic Isolation 

* • .*.# . • **•**. 

. . r . ; V. t [ * . ; . . . ; * . * . / ' 

: • •• .. ! V s » •. • ’ :• . - • 

I, i’. • . • *• '* * * . : < 

’ :!• . ■ . rjr .. • , • • •; ^ 

• .^i- : : : JU • . • • ••*.* : *. ■■■ ;•••. 

• • . . . .. \ ■ [ •. ./•; . . ; . ■ .. • 

; vsiibii-llb.fti 2.o*J 1 

.Program Description: . !• • ‘ 

* • . . 

. . . Long summer field trips.- Students would be motivated as well as educated i 

by trips to cities as much as several hundred miles away. Private boarding schools 
’ -could provide a relatively inexpensive place to stay and an opportunity to experience 
& totally different cultural atmosphere. However, Indian students would be watching 
a similar educational process to their own. • ... . .. : 

'• ” '■ ‘ ’* • :/■ ’ !; ‘ .• • •' '* .*• * .» » 

■ ■ :, r -i , . *; •-■? 

. •! t i ■ . ••• . • . 1 

i *. . ‘ ‘ ■ ■ ’ * ' 

f • . / 

/ 


. - • 

Pilot Program 


Operational Program 


What: . 

• • «, 

* * *1 . 

' * 1 . * 

* , 1 *' * * * * 

ft- 1 


2 2-week field trips, one 
for 30 elementary children, 
fcone for 30 high school 

students. 

• 


About 400 2-week trips for 30 
children per summer. Enough 
trips would be arranged so that 
every child would go on 2 during 
his school career.- 

t 


Where: 

< . 

i . * J 


1 Navajo to Los Angeles 
1 Pine Ridge to Chicago 

t 


About 2 from every reservation 
per summer, not always to the 
same city 


When: . 

t t 

» 

i 


late June/early July, 1969 


1970, if pilot is successful until 
1982 


How: 

,* i ’ 



1 • 

• 


Select children randomly 
Use parents & college students 
from host city as 
Arrange room & board at schoc 


■ ■ V ' ■ • • 

Tin host cityy 


# ( * 

Schedule: 

• ' 

• i 1 


. ’ 

. • • * , i 


* . • * ‘ . . • • * 

1 ** ,1 

v ; ^ _ ____ • ' 


^ - — - - - ------- . - ^ * - 1 7 


' Costs: 

Personnel * . 

V 

• 


2 tchrsirom home school- no < 
4 parents - $400^ 

4 college students - $400 


;xtra cost. *iuu ccnrs 1 

800 parents 80, 000 | 

800 students 80, 000 j 


Facilities: 


i;oom &t board @ 2k/sch. = 4k 
(Assume reduced rate-contribv 


room & board @ 2k/school= J 
tation) r r 1- $80, 0k .. I 


Equipment: 

w • 


charter bus (2) 2, 000 


busses 400 400,000 j 


Other: 

. TOTAL: *.'* 

* ' ; ' • *• ' ' ’ • 


. * 


. ' ' • 1 


••• • •' $6, 800. 85-94 


) $1,360, 000 \ 
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PROJECT DIAGNOSTIC SHEET 



Instructions: . 

1. Enter value factor in Column 1, A and B. _ ( 

' 2. If re.-allocated funds, enter value factor in Column 2, A and B. 
. 3. .Follow through steps indicated in C. 

4. Enter Cost-Effectiveness Index (CEI) inbox on next page. 
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A. Problem Area 



1. Percciv id need * • 

determine from location rank order 
list (top. of list=10, bottom-0) 

B. Project Suggestion 

2. Constraints s 

Assess constraints total on basis of 
• - • consideration of real factors such 
as acceptability to extra-school 
authorities, staff, teachers, parents, 
community members, also time, 
space. : ; 

3. - Benefits from change 

a. Student achievement -anticipated ’ 
likelihood that project will materially 
. ... . • affect student academic achievement. 

b. Student satisfaction-anticipated likeli- 



o 

c. Improved staff and teacher attitude and 
ri effectiveness . . : f * 

;'4, Human Resources available 

Are there personnel available who will 



carry out the project. 
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Value 

Factor (VF) 
Range 


VF 

Proposed 

Project 


VF 

Lost 

Service 


0 to 10 

* . i 


V 

r 


V 1 


0 to -10 

f 


-2. 


• 


0 to 1 0 x . 7 

♦* 


#2. 


i 


0 to 1 0 x . 3 
sits . 


S'O 


• 


f—r 

0 to 5 


3'0 




0 to 5 

) 


• 

m 

m 


• 

* • * 


V factor total /pg 


* 



JL 



MM 



HMliil 



.1 
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c. Cost Efficiency Index (CEI) 



o 



1. Re -allocated funds 

a. If project were to be permanently adopted, 

• what is likely to be cost per pupil served 

F factor = 0 

' Z factor 

b. Multiply 1/F x V = 

• t 

c. To determine trade-off loss, develop V' 
factor using column 2 for service being 
dropped by reallocation of funds. 

d. What is cost per pupil served of service 
being dropped? 

F 1 factor = 



e. Multiply 2/F* x V ,ss 

f. Z-Z 1 = CEI enter below 



Z factor 



2. New Funds 

a. Multiply F factor step C.l.a. above by 1.5 
• if finds are available but unallocated 

N factor = n o _ 

b. Multiply: l/F x N = CEI enter below 

c. Multiply F' factor step C. l.a. by 4 if funds 
unavailable but possible to obtain 

N 1 factor = 



d. Multiply: 1/FxN 1 



CEI enter below 



Project CEI 
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BIA EDUCATION PROGRAM DESCRIPTION 






Problem: STUDENT INHIBITION IN TIE CLASSROOM 



i 

•• i 



TC 



0 9 

0 

I 



T(io i M£’r Solo : 7 . ' ' 

• * . ; i ' , . • / • 

■Program Description:" SEPARATE STUDENTS, BY SEX FOR CLASSROOM WORK. 



This would perhaps be one, per area or one ‘.per tribal -group. During the student 
group activities Abt Associates Inc. undertook while in the field, we discovered 
that students (particularly, junior high through high school) were more talkative 
less shy about interacting in groups when they were forking in sexually homo - 
.geneous groups. This probably relates to the roles men and women play in many , 
Indian groups which are different and more clearly defined than those generally played! 
by their counterparts in . . .middle -clas s white society.* ‘A total class group j 

(about 25 students) could be the* same sex or a sexually -mixed clas 4 could be ; 

divided into separate boy and girl. work and study groups. The critical population 

here is grades 6-9.. j 



Pilot Program 



Operational Program 



What: 



Sexua’lly homogeneous* work 
study gr.oups for class work. 



Same. 



i 



Where; 



One school^.per area or one 
distinct tribal group: 
Grades 6-9 only. 



Whene\fel: it is clear that student | 
interaction and academic achieve-! 
ment are. enhanced by homogeneou 
groups. This is more likely amoni 



"t he - mo re * traditiona - l- Na - vaj o - t - han 
■among the acculturated Chippewa.} 



When: 



Beginning school year 69-70 
Limit on -experiment. is three 
years , - * 



Should be implemented as soon as it i { - 



el c - a - r - tha t - the - e - xp e ramont - v w rk -s 



How: 



Assign boy s* ! and girls to dif- 
ferent rooms or else train 
* • • 

teachers to work with small, 

• sexually homogeneous groups 



Same. 



Schedule: 



'"Costs: 



Begin school year 69-70 
3-year experiment; be- 
coming fully* ope rational as 



Pilot program.becomes operations 
lterm after it is clear experiment 
is successful. Continues operations 



s non as it'is clear fE works.! '3* lung qp it U nece ssranry 



Personnel 



Possible training costs to 
train teaehers to work with 
-e mail groups r- 





Possible cosFin class 



- schcduling - 
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Instructions: 

1 , Enter value factor in Column 1, A and B. 

' 2, If re.-allocated funds, enter value factor in Column 2, A and B. 

3. Follow through steps indicated in C. 

4 . Enter Cost-Effectiveness Index (CEI) in box on next page. 
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A. Problem Area 



1 # Perceived need 

determine from location rank order 
list (top of list=10, bottom- 0) 

B. Project Suggestion- 

2, Constraints 

As s ess constraints total on basis of 
consideration of real factors such 
as acceptability to extra-school 
authorities, staff, teachers, parents, 
community members, also time, 
space, 

3, - Benefits from change 

a. Student achievement-anticipated 
likelihood that project will materially 
' affect student academic achievement, 

b. Student satisfaction-anticipated likeli- 



c. Improved staff and teacher attitude and 
: effectiveness . • . . . ... . •* . . . * . 



r 4v Human Resources available 

Are there personnel available who will 



carry out the project, 
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V factor total 
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/o 



- 1 " 1 
Value 

Factor (VF) 
Range 


VF 

Proposed 

Project 


VF 

Lost 

Service 




V 


V 1 


0 to 10 




3 


0 to -10 




« 




-\ 


0 


t f* 






0 to 10 x . 7 


6-5 


Z 


0 to 10 x , 3 




/ 


jnts. 




/ 


r — 

0 to 5 


y 


/ 


0 to 5 


r 


3 


> .. 


• • 

0 
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C. Cost Efficiency Index (CEI) 



1. Re -allocated funds 

a. If project were to be permanently adopted, 
what is likely to be cost per pupil served 

F factor = 

Z factor *7_ • 



b. Multiply l/F x V = 

c. To determine trade-off loss, develop V' 
factor using column 2 for service being 
dropped by reallocation of funds. 

* d; “What is cost per pupil served of service 

being dropped? 

F’ factor = 3± * ° 



e. Multiply 2/F’ x V 1 - Z factor 

r 

f. Z-Z 1 = CEI enter below 

v 



2. New Funds 

a. Multiply F factor step C. l.a. above by 1. 5 
• if finds are available but unallocated 

•’ N factor = 



b. ' Multiply: l/F x N = CEI enter below 

c. Multiply F factor step C. l.a. by 4 if funds 
unavailable but possible to obtain 

N 1 factor = 



■ : d. Multiply: l/F x N 1 = CEI enter below 



Project CEI i m. 
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programs applicable to the school process model 



Information Exchange Newsletter 
Vocational Mobility in School 
Parent Orientation Film 
Innovation Council at Each BIA School 

Increase Research and Development Sources of Funding 

Academic Achievement Awards of Trips to Europe for High School Students 
Local School Control of a Substantial Portion of the School Operating Budget 

Indian Elite School 

Parent Education in Student Evaluation Methods 
BIA School-Wide Testing Program 
Recruitment of More Indian Teachers 
Radio Ham Shacks in All High Schools 

R&D Sabbaticals for Innovative Teachers and Administrators 
Parent School Orientation 

Cost-Effectiveness Evaluation System for BIA Schools 
Foster Homes Near Central Schools 
College System at the High School Level 
Income -Producing Educational Projects 

Incentives Given for Improved Principal Performance and Selection 
Procedures 

Local Control of Indian Schools Through Parent School Boards 
Parent Education Through Master Teachers 
• College Preparatory Schools on Post-High School Level 
Funds For Prospective College Students 
Contract Schools 
College Scholarship Program 

Student Involvement in Recruitment of Teachers 
Quadrupled Contract R&D Budget 
Mobile Schools: Truck, Ship, Airborne. 

Family Cottage Boarding 
Multiple Small Day Schools 
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Chapter III 

CURRICULUM EVALUATION MODEL 
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I. OVERVIEW 

The Curriculum Evaluation Model is a technique for calculating the 
cost-effectiveness of alternative curriculum materials by a detailed break- 
down and analysis of their components, quality, and cost. Most broadly, 
the curriculum materials under evaluation must meet requirements in 
four major categories : coverage, appropriateness, motivational effective - 

ness, and cost. 

These categories do not all lend themselves equally to objective 
evaluation. While the cost of curriculum materials may be represented 




If 



in dollars with a high degree of accuracy, measurement of coverage, ap - j 

propriateness, and motivational effectiveness must rely to a great extent j 

on the considered judgment of individuals. This is all the more true m cases j 

where new curriculum materials are being evaluated with a view to their ] 

purchase. It is possible, however, to ensure a considerable degree of ob- j 

jectivity by the establishment of a variety of standards which the ideal cur- j 

ruculum should meet, and by the assignment of relative degrees of import- ] 

ance to each of these criteria. The model thus recognizes the need for j 

personal judgments at the same time that it guards against the veryhu- j 

man tendency to accept or reject on the basis of only a few criteria. j 

It will be noted, also, that measurement of the appropriateness and j 

% 

motivational effectiveness of curriculum materials must depend on an ac- | 

curate representation of the views of the students and teachers themselves. j 

A shop course, for example, may seem to be highly useful in helping stu- | 

dents to attain their educational goals, if these goals are assumed to in- j 

elude preparation for blue-collar employment. Should the students instead j 

desire to attend college after graduation, the course may in fact be hinder- j 

I 

ing their progress. j 

Goals vary from region to region, from tribe to tribe, from school ] 

to school, and from student to student. The only way, therefore, to deter 
mine whether curriculum materials are in fact consonant with the goals 
and desires of students and teachers is to offer them the opportunity to ex 
press their opinions. Part of this model, is, therefore, a set of question- 
naires, for students, teachers, and administrators, by which preferences 
may be defined. The processing of these questionnaires must precede 

j 
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the completion of those parts of the evaluation which measure the degree 
to which the curriculum materials are consonant with the expressed goals 
and preferences of students and teachers. This aspect of the model is in- 
tended both to permit accurate evaluation of curriuclum materials and to 
facilitate understanding among teachers, students, and administrators. 

Its design recognizes also that curriculum materials, to be effective in 
the classroom, must be acceptable to both students and teachers. 

The model, therefore, suggests guidelines for a quantitative mea- 
surement of the curriculum, on a scale of 0 to 200; each of the four major 
criteria described above is considered to be of equal importance, and is 
therefore rated on a scale of 0 to 50. These four criteria are futher 
broken down into their major and minor components; the score in every 
category is the sum of the scores of its components. A high aggregate 
score, however, is not invariably the sign of highly desirable curriculum 
materials. For example, one textbook might receive a rating of 50 in the 
categories of cost, coverage, and appropriateness, while receiving a rat- 
ing of 10 in the category of motivational effectiveness. Another textbook 
might receive ratings of 35 points each in all categories. In this case, 
although the aggregate score of the former is twenty points higher than 
that of die latter, the second book is probably preferable. In a later sec- 
tion of this model, the implications and applications of the primary data will 

be discussed in greater detail. 

This curriculum evaluation model is deisgned for its users. It is 
dependent on its users for their judgments not only of the quality of curri- 
cula, but also of the validity of the model. The same numerical weighting, 
both of the major criteria and of their components, may not be equally 
applicable to all situations in all schools. It is therefore advisable that 
users of the model, once they have completed the evaluation in the proposed 
manner, consider carefully the numerical weights suggested by the model, 
and, if they believe itnecessary, make alterations in them. The user is 
cautioned, however, to adhere to the weightings suggested by the model m 
his first evaluation to prevent his own preferences from unconsciously pre- 

judicing the results. 

In succeeding pages will be found a chart and an outline represent- 
ing the components of curriculum cost-effectiveness, a detailed descr'p 
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of the rationale and procedure for the evaluation of major and lesser com 
ponents, questionnaires, and a discussion of methods of analyzing the pri 
mary evaluation data, 

II. COMPONENTS AND WEIGHTS 

On a scale of 0 to 200 points. ( If any of these scores are very low, the 
entire curriculum should be rejected. ) 

I. Coverage (50) 

A. National, state, and college standards (30) 

1. Standardized test preparation (10) 

a. state (6) 

b. national (4) 

2. State coverage requirements (15) 

3. College entry requirements (5) 

a. junior college (1) 

b. state university (3) 

c. highest selectivity private university (1) 

B. Qualitative comparison with standard materials (20) 

1. Scope (4) 

2. Detail (4) 

3. Accuracy (4) 

4. Clarity (4) 

5. Logic of sequence (4) 

II. Appropriateness (50) 

A. Utility (10) 

1. College preparation 

2. Blue-collar job preparation 

3. White-collar job preparation 

B. Difficulty (10) 

1. Substantive (5) 

a. for teacher (2) 

b. for student (3) 

2. Linguistic (5) 
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C. Suitability of media to material (10) 

D. Suitability of media to student needs (10) 

1. Direction (5) 

a. directive 

b. non-directive 

2. Structure (5) 

I 

a. structured 

b. unstructured 

E. Graphic (10) 

1. Type size (2) 

2. Proportion of printed to visual materials (8) 



III. Motivational Effectiveness (50) 

A. Teacher (20) 

1. Stimulation (6) 

a. subject -relevant 

b. subject-irrelevant 

2. Perceived utility (8) 

a. cross -topical transfer motivation (3) 

b. intensive study motivation (3) 

c. increased scope motivation (2) 

3. Demand level (6) 

a. below level of teacher preference 

b. at level of teacher preference 

c. above level of teacher preference 

B. Student (30) 

1. Stimulation (4) 

a. subject -relevant 

b. subject-irrelevant 

2. Perceived utility (10)- 

a. academic (6) 

b. employment (4) 

3. Cultural relevance (14) 
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Demand level (2) 

a. below level of student preference 

b. at level of student preference 

c. above level of student preference 

IV. Cost' (50) 

A. Dollar cost (30) 

1. Basic materials 

2. Supplementary materials 

3. Necessary equipment and facilities 

4. Necessary teacher training 

B. Time cost (20) 

1. Student (10) 

a. class time 

b. daily preparation 

c. projects 

2. Teacher (10) 

a. class time 

b. daily preparation 

c. training time 

III. OBTAINING THE INPUTS: RATIONALE AND INSTRUCTIONS 
Coverage 

Curriculum coverage is measured in two principal ways, against 
national, state, and college standards, and against the quality of the cov- 
erage offered by standard curriculum materials in the field and grade level 
of the materials being evaluated. Of the fifty points allotted to coverage, 
thirty are assigned to the first of these dimensions and twenty to the second. 

National, State and College Standards 

This section is divided between standardized test preparation (ten 
points), state coverage requirements (fifteen points ), and college entry 
requirements (five points). 
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Standardized test preparation is further subdivided between state- 
wide and national tests. In this case, as in all others where subdivisions 
are assigned numerical weights, the small e st subdivisions must be rate d. 
first , as their sum is the rating given to the next highest division. In this 
example, the sum of the ratings given to "state test preparation" (six points 
maximum) and to "nation test preparation (four points maximum) yields 
the rating for "standardized test preparation" (ten points maximum). 
Similarly, the rating given to "national, state, and college standards is 
the sum of the ratings given to "standardized test preparation, " "state 
coverage requirements, " and "college entry requirements;" it is in turn 
added to the rating given to "comparison with standard materials" to yield 

the overall rating for "coverage. 

Unless data is available on the relative performance on state and 

national examinations of students using these and other curriculum ma- 
terials, it will probably be necessary to estimate the degree to which the 
materials are helpful in preparing the students. This may be done simply 
by studying examinations given in past years to determine whether the in- 
formation they demand is included in the curriculum materials. 

In the case of new materials, evidence supplied by the publisher is 
admis sable as a partial basis of judgment, although only where the materi- 
als have been tested on school populations imilar to that in the school where 
this, evaluation is taking place, and where substantial proof of efficacy has 
been presented. The teacher -evaluator should decide whether the use of 
these curriculum materials has had (or in the case of new materials, will 
have) a significant effect on student preparedness for standardized examina- 
tions. If extreme improvement has been or is likely to be shown, the maxi- 
mum rating should be assigned; if a sharp decrease in preparedness, the 
rating should be 0. If neither improvement nor decrease has been or is 
likely to be noted, an average rating (3, in the case of state tests, and 2, 

for national tests) should be assigned; 

The degree to which the curriculum materials meet state coverage 

requirements is an important measure of its usefulness in the school. 
Failure to meet these requirements may adversely affect student perfor- 
mance on standardized tests, on state university entrance examinations, 
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and in any subsequent education in public schools or institutions of higher 
learning within the state. In most cases, state boards of education state 
quite specifically those topics which are to be studied in each subject at 
each grade level. Curriculum materials which fulfill in every particular 
the state requirements should receive a rating of fifteen points; those which 
in no way conform to these requirements should receive a rating of zero. 
Intermediate numbers should, as throughout the evaluation, be used to ex- 
press gradations between absolute success and failure in meeting criteria. 

A value of five points is assigned to "college entry requirements. " 
This is subdivided further among the requirements of the state university, 
local junior colleges, and of the highest quality private colleges. Of these, 
the state university is probably of the greatest importance, as it is to this 
institution that most students will probably go for thigher education. Cur- 
riculum materials which meet the entrance standards of junior colleges 
should receive a rating of one point; those which meet the entrance stan- 
dards of both junior colleges and the state university should receive a rat- 
ing of four points; those which meet the entrance requirements of junior 
colleges, the state university, and the most highly selective private colleges 
should receive ratings of five points. 

Qualitative Comparison with Standard Materials 

The quality of curriculum materials is to be measured by com- 
parison with standard curriculum materials in the same subject area and 
grade level, according to five factors: Scope, detail, accuracy, clarity, 
and logicality of sequence. The curriculum materials are to be rated from 
0 to 4 on each of these counts; the highest possible overall rating for "quali- 
tative comparison with standard materials" is therefore twenty. Obvi- 
ously, a score of twenty is unlikely to be achieved. For example, scope 
or breadth of coverage and detail of coverage are likely to be to some ex- 
tent mutually exclusive. In each of the five categories, a rating of four 
should indicate outstanding superiority to standard materials, a rating of 
zero extreme inferiority, and a rating of two approximate equivalence. 







Appropriatenes s 

The appropriateness of curriculum materials is measured along five 
dimensions, each of which receives a weighting of ten points: utility, 
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difficulty, suitability of media to material, suitability of media to student 
needs, and graphic appropriateness. Each of these categories is further 
subdivided into its components. 

Utility 

The utility of curriculum materials is dependent on the purpose they 
are intended to serve. It is, therefore, necessary to obtain a clear idea 
of student goals, from the questionnaire which is appended to this model. 

A chart should therefore be made, illustrating the percentage of students 
who intend to pursue college, white-collar, and blue-collar careers, and 
the utility of the curriculum materials toward the fulfillment of these 
goals : 

Student Goals 

10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 

college 

white-collar 

blue-collar | | | I 111 , 

Curriculum Utility 




The approximate percentage of students planning to follow each type of career 
should be entered on the upper chart by blacking in the appropriate number 
of boxes in each category. On the lower chart, the usefulness of the cur- 
riculum materials to students planning to follow each type of career should 
be rated from 1 to 10. (The number of boxes filled in on the lower chart 
need not be limited to ten. ) To arrive at an overall rating of utility, the 
number of blacked -in boxes on the upper chart, for which the correspond- 
ing boxes on the lower chart are also blacked in, in counted. This will be 
a number from one to ten. 

For example, if half the students indicate an intention to pursue 
college* careers, and half white-collar careers. and the curriculum materials 
have received a college utility rating of 3 and a white-collar utility rating 
of 10, the overall curriculum utility rating would be 3. With this school 
population, a film on carpentry which received a blue-collar utility rating 
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of 10 would receive an overall utility rating of 0, as it does not correspond 
to student needs . 

Difficulty 

Curriculum materials are to be rated according to their substan- 
tive and linguistic difficulty. Substantive difficulty is subdivided between 
difficulty for students and for teachers. Curriculum materials which place 
inordinately great or insufficient demands on the students' capacity to ab- 
sorb and understand should receive a rating of 0; those which place com- 
pletely appropriate demands should receive a rating of 3; and materials 
which place moderately inappropriate demands should receive ratings. of 
1 or 2. Curriculum materials which place appropriate demands on 
teachers should receive a rating of 2 in that category. In some cases, as 
for example tile "new math, " students may be able to understand the ma- 
terials, but teachers, owing to a lack of training m this approach to the 
subject, may not be able to offer satisfactory instruction; in such cases, 
a rating of 0 should be given. A rating of 1 should be given m cases of 
moderate appropriateness of substantive difficulty for the teacher. 

Linguistic difficulty is measured on a scale of 0 to 5. A rating of 
5 indicates that the materials are entirely appropriate to the students ' 
reading ability. A rating of 0 indicates that the materials are written at a 
level of difficulty falling either far above or far below tile students' ability. 
Intermediate ratings should again be used to represent gradations of ap- 
propriateness. 

Suitability of Media to Material 

A value of ten points is assigned to this cateforey, which measures 
whether the media employed to teach the material are appropriate means 
of conveying knowledge in the subject area. For example, a textbook might 
be an entirely appropriate means of teaching English literature, and should 
therefore receive a rating of ten; it might, however, be an entirely inap- 
propriate means of teaching shop, home economics, or drama, and shoul 
therefore receive a rating of 0. A series of films might be extremely use- 
ful in teaching government, but inappropriate to instruction in English liter a. 
ture. Intermediate numbers should be used to indicate gradations of ap 

p r op r iatene s s . 
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Suitability of Media to Student Needs 

This category is subdivided between direction and structure, each 
of which is valued at five points. Directive instruction implies a high de- 
gree of control by the teacher over the student's activities; the student 
performs tasks assigned him by the teacher under his or her supervision. 
Non-directive insturction implies a much greater degree of autonomy and 
self-reliance on the part of the student. (Studies have shown that non-directive 
instruction tends to be the most successful with highly intelligent and mo- 
tivated students; less intelligent and motivated students tend to need con- 
siderable direction from the teacher. ) 

A workbook, in which tasks are assigned specifically, is an example 
of directive instruction; educational games or individual research projects, 
the progress of which is not directly supervised, are examples of non- 
directive techniques. In this category, the curriculum materials should be 
rated from 0 to 5, according to the degree to which they lend themselves 
to teaching techniques of a level of directivity appropriate to the needs of 
the students. 

The curriculum materials should also be rated from 0 to 5 accord- 
ing to the degree to which they permit a level of structure appropriate to the 
students' needs. Structured instruction implies rigid achievement goals, 
established by the teacher, stressing output. Unstructured instruction im- 
plies emphasis on the learning process itself; the decision making, problem 
solving, and individual creativity of the student are of greater importance 
than set output goals. Here again, unstructured instruction is usually 
better suited to pupils of high intelligence and motivation. 

Graphics 

Graphic appropriateness is subdivided between type size (two points) 
and the relative proportion of printed and visual matter (eight points). The 
evaluators should, in the first instance, estimate whether the type is large 
enough to suit the needs of the children for whom it is designed. Next, he 
should estimate whether there are sufficient illustrations, maps, or charts 
to meet the children's informational needs and to stimulate them to read the 
printed matter. 



10-112 



Motivational Effectiveness 



Motivational effectivenss (fifty points ) is an extremely critical re- 
quirement of curriculum effectiveness. In all learning situations, there 
is a tradeoff between such pairs of factors as scope and depth, and student 
entertainment and student achievement. In every case, however, the level 
of each variable, and their degree of mutual exclusivity, is contingent on 
the level of student motivation. This may be represented by a chart: 

scope entertainment motivation depth achievement 

high I 



j low l 

The lines at the left and right represent the two variables; the line in the 
center represents the level of student motivation. The possible tradeoffs, 
at a given level of motivation, may be approximated by drawing connecting 
lines from the left to the right-hand line, such that the connectives pass 
through the motivation line at the appropriate level. Where motivation is 
low, therefore, both student entertainment and achievement are likely to 
be low; where motivation is high, both are likely to be high, where moti 
yation is moderate, both my be moderate, or one may be high and the 
other low. The purpose of this chart is not so much to aid in evaluation of 
motivational effectiveness as to stress the importance of this criterion. 
Curriculum materials must be evaluated as to their motivational effective- 
ness for both students and teachers. These subdivisions are assigned 
values of thirty and twenty points, respectively. 

Teacher Motivation 

In order for teacher to offer instruction at the peak of their ability 
they, as well as the students, must be motivated. Three factors are cri- 
tical: stimulation (six points), perceived utility (eight points), and demand 

level (six points). Stimulation is subdivided between that which is relevant 
and that which is irrelevant to the subject being taught. That is, curriculum 
materials may be highly entertaining, but may not stimulate the teacher 
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either to improve his knowledge of the subject matter or to teach his sub- 
ject to the best of his ability. Stimulation should therefore be rated from 
0 to 6; curriculum materials which are highly stimulating, but not in a 
manner relevant to the subject, should receive a maximum rating of two 
points . 

Perceived utility (eight points) is subdivided between cross -topical 
transfer motivation (three points), intensive study motivation (three points), 
and increased scope motivation (two points). Cross -topical transfer mo- 
tivation refers to the efficacy of the materials in stimulating the teacher 
to study other fields of relevance to his subject. History materials, for 
example, might stimulate a teacher to study the literature or economics 
of the period in question. Intensive study motivation refers to individual 
research in detail into the topic being studied. Increased scope motivation 
refers to breadth of study within the field. 

The third major criterion of teacher motivational effectiveness is 
the level of demand placed on their time, energy, and knowledge. Curri- 
culum materials which create a demand consonant with teacher preferences 
should receive a rating of six; those which demand either too much or too 
little of teachers should receive lower ratings. On the whole, teaching 
materials which demand slightly too much are preferable to those which 
demand too little. It is difficult, however, to represent this quantitatively, 
and the evaluator's judgment must be relied upon for an estimation of 
teacher capabilities. 

Student Motivation 

Student motivation has been found to be divisible into four major 
components: stimulation (four points), perceived utility (ten points), cul- 

tural relevance (fourteen points ), and demand level (two points). There 
will, of course, be overlap among several of these categories. 

Stimulation should be rated from 0 to 4; materials which are highly 
stimulating, but not in a manner related to the subject, should receive a 
rating of one point. 

Perceived utility is subdivided between academic (six points) and em 
ployment (four points) utility. 

Cultural relevance is a highly critical criterion. For curriculum 
materials to be relevant to Indians, they need not be devoted entirely to 



Indians or aimed specifcally at Indians. Rather, they should be materials 
to which the Indian child can relate. In subject areas where these criteria 
are applicable, they should be free of racial or religious bias, open or im- 
plied; free of middle -class bias; neither contemptuous not condescending 
toward the American Indian; cognizant of rural as well as urban America; 
cognizant of the problems of minority groups in general; and so on. Ma- 
terials which can be used to draw analogies to specifically Indian problems 
and situations are often quite as "Indian relevant, " and sometimes more so, 
than materials which deal specifically with aspects of Indian culture or 
history with which students are familiar. The high point rating (fourteen) 
is an indication of the importance which the analysts have found to be at- 
tached to this particular criterion of curriculum motivational effectiveness. 

The student demand level should be rated on a scale of 0 to 2; ap- 
propriate demand should receive a rating of 2, and inappropriate demand, 
whether excessive or insufficient, should receive a rating of 0 or 1, de- 
pending on its degree. 

Cost 

Dollar costs are to be measured against average class size. For 
purposes of illustration, let us assume that the average class is composed 
of twenty students. The cost of such materials as films and projectors on 
which to show them, must be distributed over all classes which will use 
them. The average lifespan of materials must also be taken into considera- 
tion. If, for example, three classes each year will use the films and pro- 
jectors; if the average life span of usefulness of a textbook is five years, 
and of a film ten years; and if workbooks are to be replaced yearly, dollar 
costs could be computed in the following manner: (over a ten-year period) 



60 texts @$5x2 (accounting for replace- 
ment after five years) = $ 600 

60 workbooks @ $2 x 10 (replaced annually = $1,200 

8 filmstrips @ $40 = $ 320 

4 films @ $200 = $ 800 

1 projector @ $500 = $ 500 

$3,420 subtotal 
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In addition, the costs of teacher training must be considered. If $5 00 worth of 
training is required; if the teacher can be expected to teach all three classes, 
and if teacher turnover rates indicate that after five years, a new teacher will 
have to be trained in use of the materials, training costs over a ten year period 
will be $1000. 

$1000 

3420 

$4420 divided by 10 = $442 
$442 divided by 3 = $147. 33 per class of 20 annually 

It will be noticed that the suggested value assigned to dollar costs is "30". 
Clearly, the least expensive materials will receive the highest number in this 
category, and the most expensive materials the lowest number. This does 
not indicate, of course, that inexpensive materials are preferable to expensive 
materials. It is, however, necessary to determine on the basis of other, parts 
of this evaluation, whether the purchase of more expensive materials is getting 
his money's worth, and whether the purchaser of inexpensive materials is 
practising false economy. 

After ascertaining what the average cost of materials in the subject 
area of those being evaluated, rate the materials according to the degree to 
which they fall below or exceed average dollar costs. A rating of "15" indicates 
that the dollar cost of the materials is average; a rating of "0" indicates that 
they are remarkably more expensive, and a rating of "30" that they are remark- 
ably less expensive than average. Gradations are expressed by using 
intermediate numbers. 

Time Costs 

It is necessary to consider® time as well as dollar costs, as time, like 
money, is a valuable and limited resource. The necessity of evaluation along 
this dimension is clear; a course which demands twice as much classroom 
and homework time as the average class may well cause students to learn 
more, but they may do so to the deter iment of their other studies. It is 
necessary also to determine whether additional time expenditure is efficient, 
does the student learn twice as much in 20 hours a week of study as in 10? In 
order to evaluate student time cost, it is first necessary to estimate the amount 
of time expended each week by the average student on his academic classes. 
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This number should be divided by the number of courses to determine time 
expenditure on the average course. To this should be added the amount of time 
spent each month or semester on outside projects, reading, etc. , divided by 
the appropriate number of weeks. 

Thus: 

25 hours per week class time 
15 hours per week homework 

4 hours per week projects (16 hrs. per month, divided by 4) 

44 hours per week student work 

divided by 4 courses = 11 hours per week average course requirement. 

If the amount of time required by the course materials under evaluation is 
equal to the average, place a "5" in the "student time cost" box. If remarkably 
less time is required, place a "10" in that box. If remarkably more time is 
required, place a "0" in that box. Use intermediate numbers to express 
gradations of time cost. 

Teacher time cost is to be evaluated similarly. Time spent training for 
the course must be averaged in, as well as time spent in class, correction 
of homework, and daily preparation. 

When dollar costs, teacher time costs, and student time costs have been 
computed, add them together . The sum will be a number from "0" to "50". 

A "0" indicates that the entire cost, in dollars and time, is extraordinarily 
high; a "50" that the cost is extraordinarily low. It is, of course, unlikely 
that the figure will be either number. Enter this figure in the "cost" box. 

IV. UTILITIES 

The product of the processes described in the previous section of the 
model should be a number from 0 to 200, representing the sum of the ratings, 
from 0 to 50, of the four major components: coverage, appropriateness, 
activational effectiveness, and cost. Each of these is in turn the product of its 
component. This number is not in itself highly useful, except in that it has 
compelled a numerical assessment of the curriculum along a variety of dimensions. 
The model is highly useful, however, when several alternative curriculum 
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materials in the same subject area are compared. In this way, certain 
apparent discrepancies (such as the low rating which most mathematics 

courses will receive in "cultural relevance") are resolved. 

This single number is not, however, the only index of curriculum 
quality For example, a set of curriculum materials which receives a 
rating of 50 in coverage, motivational effectiveness, and cost, hut a rating 
of 0 in appropriateness, is undoubtedly inferior, for use. in the school, to 
a curriculum which receives ratings of 35 in each category, for a lower aggre- 
gate score. To order to obtain an index of ove rall usefulness, apart fr om 
cosh the scores for coverage, appropriateness, and motivational effectiven ess 
s hould he multiplied . This product may be multiplied by the cost rating, 
depending on the budgetary constraints imposed on the school. These three 
scores will provide considerable assistance in assessing the relative costs and 

benefits of alternative materials. 

In assessing the data, however, the evaluator is cautioned to examine 
the ratings of specific sub-divisions as well. An extremely low rating for 
some of these sub-divisions must place in doubt the overall value of the curri- 
culum materials as a whole. Among these crucial criteria are accuracy 
(I.B.3), utility (II. A), motivational effectiveness for teacher (III. A) motiva- 
tional effectiveness for student (HI. B), perceived utility to students • >. 

and cultural relevance (III. B. 3). Other critical requirements may be added 

to this group at the discretion of the evaluator. 

The Curriculum Evaluation Model is not, then, infallible. Designed 
to take into account the needs and preferences of individuals, it is susceptible 
as well to human error. If it is used conscientiously, however, with appropriate 
adjustments in the weightings made by the evaluator, it is useful means of 
comparing the quality and cost-effectiveness of alternative curriculum materials. 
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V. RATINGS 

To be filled in by the evaluator : 



Initial Ratings 

I. Coverage (_ 



of maximum 50) 



A. National, state, and college standards (_ 

1 . • ' 

a. state ( of max. 6) 

of max. 4) 



of max. 30) 



b. national (_ 



of max. 15) 



2. State coverage requirements ( 

3. College entry requirements ( of max. 5) 

a. junior college ( of max. 1) 



b. state university ( of max. 3) 



c. highest selectivity private university (_ 



B. Qualitative comparison with standard materials (_ 

1. scope ( of max. 4) 

2. detail (_ of max 4) 

3. accuracy ( of max. 4) 



of max. 1) 
of max. 20) 



4. clarity ( ; of max. 4) 

5. logic of sequence ( of max. 4) 



II . Appropr iatene s s (_ 
A. Utility (_ 



of max. 50) 



of max. 10) 



college 



Student Goals 

0123456789 10 

/ T~L / / I I III P 



Curriculum Usefulness 



white-collar / // // // / / // / 

i i i i i i i t i i~n 



blue-collar 

B. 
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12 3 4 
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/ 
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Difficulty ( of max. 10) 

1. substantive ( • of max. 5) 

of max. 2) 

of max. 3) 



a. for teacher ( 

b. for student ( 

2. linguistics of max. 5) 
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C. Suitability of media to material ( of max. 10) 

D. Suitability of media to student needs ( of max. 10_ 

1. direction ( of max. 5) 

2. structure ( of max. 5) 

E. Graphic ( of max. 10) 

1. type size ( of max. 2) 

2. proportion of printed to visual materials ( of max. 8) 

III. Motivational Effectiveness ( of max. 50) 

A. Teacher ( of max. 20) 

1. stimulation ( of max. 6) 

2. perceived utility ( of max. 8) 

a. cros s -topical transfer motivation ( of max. 3) 

b. intensive study motivation ( of max. 3) 

c. increases scope motivation ( of max. 2) 

3. demand level ( of max. 6) 

B. Student 

1. stimulation ( of max. 4) 

2. perceived utility ( of max. 10) 

a. academic ( of max. 6) 

b. employment ( of max. 4) 

3. cultural relevance ( of max. 14) 

4. demand level ( of max. 2) 



IV. Cost ( of max. 50) 

A. Dollar cost ( _. of max. 30) 

B. Time cost (_ of max. 20) 

1 . student ( of max. 1 0 ) 

2. teacher ( of max. 10) 
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Final Ratings 

I. Additive: 

coverage ( ) 

appropriateness ( ) 

motivational effectiveness ( ) 

cost ( ) 

total rating ( ) 



II. Multiplicative (qualitative only): 

coverage ( ) x appropriateness ( ) x motivational 

effectiveness ( ) = ( ) qualitative rating. 

III. Multiplicative (including cost): 

coverage ( ) x appropriateness ( ) x motivational effec- 
tiveness ( ) x cost ( ) = ( ) overall multiplicative 

cost-effectiveness rating. 
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Questionnaire I. Students 



1. What grade are you in at this time? (circle one) 

123456789 10 11 12 post-graduate 

2. Are you male or female? (circle one) 

male female 

3. How many years of schooling would you like to receive in all? (circle one) 

8 9 10 11 12 post-graduate two-year college 

four -year college graduate school law school 

medical school other (explain) 



4. How many years of schooling do you think you will receive in all? (circle one) 

8 9 10 11 12 post-graduate two-year college 

four -year college graduate school law school 

medical school other (explain) 

5. What sort of career do you plan to follow after you finish school? (circle one) 

blue-collar worker- (factory jobs, construction, truck driver, etc.) 

white-collar worker (clerk in an office, nursing, accountant, 

factory supervisor, etc. ) 

professional (teacher, doctor, lawyer, etc.) 

6. If you think that you will receive more years of schooling than you actually 

want, state the reason: (circle one) 

pressure from parents required by law other (explain) 



7. If you think that you will not receive as much schooling as you would like, 
state the reason: (circle one) 

won't be able to afford to 

won't be prepared adequately by the, school attended now 
other (explain) 
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Qaestionnair e II. T eacher s 



1. Of every twenty students in your classes, how many are likely to end 
their years of schooling after each of the following levels: 

8th grade two-year college 

four-year college 

graduate school 

law school 

medical school 



_9th grade 
_10th grade 
11th grade 



12th grade 

post-graduate 



other (explain) 



2. Of every twenty students in your classes, how many are likely to 
pursue the following occupations after finishing school: 

farm worker 

blue-collar worker 

white-collar worker 

' professional 



3. Where do you think the school should place greatest emphasis: (place an 
"x 11 by every area which should be emphasized, and two ’’x's 11 by the 
area which should be emphasized most) 

vocational training (blue-collar) 

vocational training (white-collar) 

academic preparation (college) 

4. How many hours do you think you should be expected to spend each week 
in preparation for each of your classes: 

reading, research, and ies son preparation 

correction of homework 

other (explain) 



5. a) Would you be interested in receiving training: 

in new teaching techniques? 

in new curriculum materials? 



b) Would you be willing: 

to attend teacher training workshops on weekends? 

to receive training in sessions lasting several weeks during the 



s umme r ? 

to receive training from written materials sent to you during 
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Summary of Teacher -Evaluation Model 



The materials included in the Teacher Evaluation Workbook 
will help the user to conduct an evaluation of eimentary and 
secondary school teachers. The evaluation might be conducted by school 
personnel (administrators, teachers, or both) or by education specialists 
brought to the school. The materials might also be adapted for student 
evaluation of teachers. 

The evaluation workbook is the basic design of a teacher evalu- 
ation model. The model has not been field tested. Different users will 
probably wish to develop the model further and to modify it to suit their 
particular needs. 

Included in the workbook are materials and. directions for con- 
ducting both an Initial Evaluation and an In-Depth Evaluation. Central 
to both the Initial and In-Depth Evaluations is the Teacher Observation 
Guide. 

The Initial Evaluation is conducted to ascertain whether the In- 
Depth Evaluation is necessary, and to make this apparent to administra- 
tors, both at the school level and above. It takes place in the three 
successive phases; the Teacher Observation Guide is used first to collect 
information from teachers on ideal teacher behavior, then to learn their 
perceptions of their own behavior, and,, lastly to evaluate teacher behav- 
ior from actual observation. 

If there are significant differences between the descriptions of 
teacher behavior as actually observed and teachers' own conception of the 
ideal teacher, or, more significantly, between teacher behavior as obser- 
ved and as perceived by the teachers, the In-Depth Evaluation would 
probably be useful. 

The In-Depth Evaluation is structured around the Teacher Eval- 
uation Model. The major inputs to this model are descriptions of the 
teacher's instructional strategy, of student instructional preferences, and 
of the teacher's behavior in class as actually observed. 

The survey instrument for determining Teacher Instructional Stra- 
tegy is a questionnaire to be filled out by the teachers. The teachers are 




asked to describe their instructional strategies in terms of goals, direc- 
tion, structure, activation, and evaluation. 

The Student Preference Inventory is a chacklist to be filled out 
by the students. It cellects information on students' long-range goals, 
classroom interaction preferences, and on the most and least liked 
classroom activities and materials. 

Information collected on both these forms is measured on master 
forms as to whether it indicates a preference for directive, non- directive 
or mixed instruction. Instructional preference descriptions of both 
students and teachers are entered on the Teacher Instructional Strategy 
and Student Preference Inventory summaries. The summary results 
are compared on the Student /Teacher Match Chart which describes student/ 
teacher match in terms of congruence of both instructional styles and 
goals. 

A measure of the degree of student and teacher match is the first 
output of the model. The workbook includes guidelines for interpreting 
student /teacher match in the section titles, "Implications of Student/ 
Teacher Match. " 

The Classroom Observation Guide is designed to help the eval- 
uator observe critically some aspects of student /teacher interaction in 
the classroom. The guide covers the major categories of teacher in- 
class behavior, teacher questions, teacher involvement, student response, 
student attention, and classroom activities. 

Information collected on the observation guide is entered on the 
Teacher Behavior /Student Response Bargraph. This bargraph is compared 
with a similar bargraph on which Suggested Standards for Evaluating 
Student Behavior and Student Response are described. The comparison 
of actual teacher behavior and student response to the suggested standards 
(or other standards developed by the evaluator or by the teachers them- 
selves) will identify student achievement and motivation factors; this is the 
second major output of the model. Guidelines for interpreting these factors 
are included in the workbook. 

The final model output is a determination, based on the Classroom 
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Activities section of the Classroom Observation Guide, of the teacher's 
success is covering curriculum content. In this section of the guide, 
classroom activities are categorized as to the degree to which they in- 
volve student participation. 

Adequate curriculum coverage in each major subject area gener- 
ally requires that students be involved in many different kinds of activities, 
ranging in the degree of student involvement from no participation at all 
to very major participation. Included in the workbook is a table of 
Typical Time Budgets for different kinds of acitivities in each major 
curriculum area. The teacher's actual time budget is compared with the 
typical time budgets, in order to determine whether the teacher is design- 
ing her classroom program so that students are adequately involved in 
activities at each participatory level. 

Descriptions of survey instruments, instrument forms, output 
forms, and guidelines for interpreting outputs are included in the 
workbook package. 
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The materials included in this package will help the user conduct 
an evaluation of elementary and secondary school teachers. The user 
can be an education specialist based outside the school or administrators 
and/or teachers within the school. The materials could also be adapted 
for student evaluation of teachers. 

The evaluation model outlined here should be considered as a de- 
sign for teacher evaluation. The model has not been field tested. Different 
users will probably want to develop the model further and modify the materials 
to suit their own needs. 

Included are materials and directions for conducting both an Initial 
Evaluation and an In-Depth Evaluation. The focus of both the Initial and In- 
Depth Evaluations is the Teacher Observation Guide. This is presented on 
page 57 and is described on the following pages. 

Since it is the teachers that are being evaluated, it would be desirable 
for the teachdrs to carry out the evaluation themselves as a faculty project or 
to work closely with administrators or educational specialists conducting the 
evaluation. This will both enlist the support of the teachers for evaluation 
and direct their attention to the different aspects of teaching considered in the 
model. 
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Initial Evaluation : 

The Initial Evaluation is conducted to find out if an In ~ Depth evalua- 
tion is necessary and to illustrate that necessity or lack of it to concerned 
school staff or non-school administrators. 

The process of the Initial Evaluation is a three-part process. Each 
part uses . the Teacher Observation Guide (page 57 ) as a survey instrument. 

In the first phase of the Initial Evaluation, teachers fill out the 
Teacher Observation Guide to describe the behavior of and student response 
elicited by the ideal teacher. This can be done in about half an hour. 

Results for the total group should be averaged^and the averaged 
results should be recorded on a master teacher observation form. 

In the second part of the process, teachers are asked to fill out 
the observation form to describe what they think are the ways they and 
their students actually behave in class. Again results should be averaged 
and recorded on a master form. 

These first two parts of the process could be done at a faculty meet- 
ing. Descriptions of ideal and supposed actual teacher behavior and any 
differences between the two identified in the first two phases of the process 
could provide the basis of useful faculty discussion. 

The third phase of the process is observation of actual teacher be- 
havior. Observation can be done by one individual or a team of people from 
the administrative or instructional 1 staffs. Each teacher should be observed 
for at least the duration of one lesson or class (approximately one hour). 




Observers should make dry runs through the observation form 
before beginning formal teacher observation. This is done so that the 



I 



observer* can familiarize himself with the form and the types of behavior 
it asks him to consider and make any modifications in the form before 
beginning actual observation. 

The output of teacher observation for the initial evaluation is a 
simple one. Observation results for the entire teacher group are averaged 
and recorded on a master observation form. If the descriptions of actual 
observed teacher behavior differ from the descriptions of supposed actual 
teacher behavior, it is a sign that In-Depth Evaluation would be useful. 

It is possible that results of observed teacher behavior will be divided, 
with one group of teachers behaving very much like the description of the 
ideal teacher and the rest of the faculty differing from the ideal more ex- 
tremely. In that case, In-Depth Evaluation may only need to be carried out 
on the teachers who are furthest from the ideal. 



If the user decides to conduct an In-Depth Evaluation, he should keep 
the observation forms of each teacher to be evaluated in-depth. These will 
be used to generate a separate output for tlj.e In-Depth Evaluation process. 
(See Evaluating Teacher Behavior and Student Response, page 68.) 



In-Depth Teacher Evaluation: 

The In-Depth Evaluation is structured around the Teacher Evaluation 



Model. The major inputs to this model are the description of the Teacher 
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Instructional Strategy and the Student Preference Inventory. 



The survey instrument for the Teacher Instructional Strategy is 
in the form of a questionnaire, to be filled out by the teachers. Teachers 
are asked to describe their instructional strategies in terms of goals, 
direction, structure, activation, and evaluation (see page 31). 

The Student Preference Inventory is in the form of a checklist to 
be filled out by students. It will collect information on student long-range 
goals, classroom interaction preferences, and most and least liked class- 
room activities and materials. 

4 

The outputs of the model are: 

1. Degree of student -teacher match, based on a 

« 

comparison of the Student Preference Inventory and the 
Teacher Instructional Strategy, to identify goal and 
instructional preference congruence. 

2. Degree of curriculum coverage, based on teacher 
grades and the formulation of the classroom program, as 
described in the Classroom Activities section of the Teacher 
Observation Guide. 

3. Identification of student motivation and achievement 
factors, based on the Teacher Observation Guide. 

Descriptions of survey instruments, the forms themselves, output 

forms, and guidelines for interpreting output are presented on the following 
pages. 
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Student Preference Inventory 

The Student Preference Inventory collects information on student 
goals, interaction preferences, and most and least liked classroom ac- 
tivities and materials. 

The Inventory is in the form of a checklist. Students should be 
asked to read through the list and mark liked and disliked items in the 
appropriate columns. The students of each teacher being evaluated should 
be asked to fill out the Inventory. The Inventory should be anonymous; 
students should not be asked to give their names. The Inventory should be 
filled out at the beginning of the In-Depth Evaluation process. 

The Student Preference Inventor y provides a way of identifying some 
of the students' attitudes about what they want to get out of school and the 
things they do and use in class. The ways students feel about these things 
will effect, to some degree, the success a teacher will have working with 
the students. This does not mean that a teacher's instructional style or 
way of working should be completely dictated by student preferences or that 
there should be total agreement between students and teacher about what to 
do and how to do it. But a good teacher will at least be aware of his students' 
likes and dislikes and will either take advantage of them or override them 
intelligently. The Student Preference Inventory provides a way of checking 
on a teacher's awareness of student attitudes and of bringing them to his 
attention if he was not aware of them before. 
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How to Administer the Student Preference Inventory: 



The Student Preference Inventory can be self -administered for 
students of the upper elementary and secondary school levels (i.e. , 
students whose reading skills are good). 

Students in the lower elementary grades can be given a numbered 
sheet with numbers corresponding to each item on the inventory. Like 
and Dislike columns should run down the list of numbers as they do on the 
regular inventory. The teacher should then read out the items one at a 
time, telling the students the corresponding number of each item. He 
might say something like "Number One: Ask yourselves 'Do I like or dis- 
like reading by myself at my desk? 1 If you like to do this, put a check in 
the first blank space next to number one. If you don't like to do this, put 
a check in the second blank space next to number one. If you neither like 
nor dislike reading by yourself at your desk, leave both spaces blank. " 

Anonymity is critical to quality of response. Respondents to ques- 
tions often give the answers they think the questioner wants to hear. Stu- 
dents responding to questions administered by the teacher about their in- 
structional preferences might be more inclined to do this than they would in 
another context. If the students know that their responses are anonymous, 
they might feel more free to express their true preferences. The importance 
of anonymity should be stressed to the teacher (or whoever may be adminis- 
tering the inventory in her place), and the teacher should stress the fact 
that the inventory is anonymous in his verbal instructions to the students. 

The teacher should introduce the inventory to the students by telling 
' them what it is for, i.e., to help him teach better. * He- might tell the 
students that if she knows something about what they like to do and use in 
class, he might be able to incorporate more of those things in his class- 
room program. He should point out that there will probably still be some 
things that they disagree on, but that they might be able to negotiate on 
these things. 

Though the teacher doesn't have to, it would be useful for him to 
give students feedback on the results of the inventory. This is a good 
tactic psychologically, as the students won't feel that they have simply 
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dropped something into a void. But more importantly, teacher feedback 
to the students could provide the basis for useful teacher -student discus- 
sions or negotiations of the kind referred to above. These discussions 
would help both teacher and students to feel that learning or instruction 
is something that they are undertaking together rather than something 
generated by the teacher and passively received by the students. In this 
way, the Student Preference Inventory serves as a device for creating 
change in the classroom completely outside of the context of the rest of 
the evaluation process. 

Additional Use of the Student Preference Inventory : 

The Student Preference Inventory could also be compared with the 
student response results of the Classroom Observation Guide to checkif the 
students actually do like the things they indicated preference for on the 
inventory. Inconsistencies between actual student response to instruc- 
tional factors and their indicated instructional preferences could generate 
useful student -teacher dialogue, or even provide the basis of a student 
evaluation which could be undertaken together by the teacher and his stu- 
dents. 
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WhattoDo with Results of the Student Preference Inventory : 

Total class results of the Student Preference Inventory should be 
recorded on the master inventory; i. e. , under classroom activities, if 10 
students indicate they like reading by themselves at their desks and 15 
indicate they do not, the number 11 10 11 should be entered next to that item 
on the master inventory and the number "IS 11 entered in the Dislike col- 
umn next to that item. This should be done for all items on the inventory. 

"Dislike" responses should be subtracted from "Like" responses 
for each item and the plus or minus weight entered in the third column 
next to each item. 

Each item on the master inventory has a letter (A, B, or C) asso- 
ciated with it. These letters describe whether the item is one indicating 
student preferences for teacher direction (A items), mixed direction and 
non-direction (B items), or non-direction (C items). The user should add 
the number of items of each type (A, B, or C) which have received plus 
weights and enter that figure under Total Number of Items column on the 
inventory summary; i.e. , of the total number of activities, 5 of the A 
type received plus weights. The number "S" should be entered on the 
Inventory Summary under Total Average Number of A type activities. 

Do this for A, B, and C items in each inventory area (activities, mate- 
rials, and interaction prefer ences). 

The user should then multiply the number of items of each type 
by the given weight for that type and enter that figure in the '.Total Weight 
column. In the example above, students indicated preference for 5 items 
of the A type. The number "5 " was entered under Total Number of A type 
activities on the Inventory Summary. A type activities have a given weight 
of +16.5. The number of items (5) is multiplied by the given weight per 
item (+16. 5) to yield the total weight for A type activities, which would be 
+82 . 5 . 

Add the three figures in the total weight column in each inventory 
area to get the total average score for that area, and enter it in the space 
marked Total Average Score. 










In the last section of the Inventory Summary, the three Total 
Average Scores for each area are added for a Total Score. The Total 
Score will be described as A, B, or C, indicating student preferences 
for directive, mixed directive and non-directive, or non-directive instruc- 
tional styles. The letter describing student instructional preferences 
should be entered on the Student-Teacher Match Chart on page 50. This 

I 

will later be compared with the findings of the Teacher Instructional Strategy 
to determine degree of student and teacher match. 
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Student Preference Inv e ntory (Elementary School Students) 

Please read through the following lists of classroom activities, 
materials, and ways of behaving in class. Mark all of the things you 
like by putting an "X" beside them in the LIKE column. Mark all of 
the things you don't like by putting an "X" beside them in the DON’T 
LIKE column. If there are some things you neither like nor dislike, 
you don't have to mark them at all, 

| '* DON'T 

Class rcom Activities LIKE LIKE 



■reading by myself at my desk 
■reading out loud 
■working by myself at my desk 
■working with other kids 
■listening to the teacher talk 
■answering the teacher's questions 
■watching teacher explain things at 1 
the black board ; 

■writing 

-doing problems at the black board 
-taking tests , j 

-taking care of pets and plapts 
-having contests with other kids 
■playing games 
-playing with toys 
-painting and drawing 
-singing 
-dancing 

-listening to music 
-doing experiments ] 

-building things j 

-watching movies j 

-giving reports in front of the class 



* 




j 



! 

I 



I 

| 

I Materials and Media 

f ■ ■ ■ 

f * 

| -School Books 




reading 

spelling 

arithmetic 

language 

science 










11- 13 8a 













! 

t 

i 

• 

i 

Student Preference Inventory (cont. ) 

j 

-Work Books ! 

reading i 

arithmetic j 

-Story Books | 

-Magazines and Comic Booksj ; 

-Slides | 

-Tape Recorder j ( 

-Records ' I 

-Toys . j . 

-Games 1 

-Crayons and Paints 
-Paper and Pencil 
-Movies 

-Animals and Plants 
I -Pictures 
-Blackboard 
-Bulletin Board 
.-Television 
J -Musical Instruments 
-Other 




mmmm. 



LIKE 



Ways of Doing Things in Class 



-answering question when teacher calls on me 
-shouting out the answer without being called on 
-saying an answer when othdr kids say it at the 
same time 

-not answering a question at' all 
-getting help from the teacher 

B -raising my hand. and asking teacher question 
B -raising my hand for teacher to come help 
me at my desk 

A-going to teacher’s desk to get help 
-getting help from other kidd 
-working or playing by myself 
-working or playing with a fdw other kids and 
the teacher ; 

I -working or playing with a few other kids and 
no teacher 

! -working or playing With bnel other kid 
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Student Preference Inventory (oont. ) DON'T 

LIKE LIKE 

-working or playing only with the teacher 

-helping other kids 

-working in front of the class at the blackboard 

-sitting with other people in a circle or around 

a table _____ 

-sitting at my desk all the time _____ ^___ 

-working and playing in different parts of the 

room at different times 

-going to different places in the school or outside 

the school to do different things 

.-working or playing with the same kids all the time ______ _____ 

-working or playing with different kids different 
times 



Student Goals 
> ■ ■ ■ 

Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a £ 
in the blank space next to the goal. If you think a goal is not very impor 

tant, mark it 0. If you think a goal is sort of important, but not one of 

the most important ones, give it a score of 1* 

I want to stay in school until I graduate from high school 

I want to stay in school until I am old enough to leave 
even though I may not graduate from high school _____ 

When I get out of school, I want to: 

get a job right away ; \ 

go into a vo-cational training program 

go to college for four years • 

go to college, for more thajh four years to become 

something like a doctor or a lawyer 

live near home j 

live far away from home 





I 
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Master Student Preference Inventory (Elementary School Students) 

Enter total class results for each item under the appropriate 
column (i.e. , 1^ students indicate they like reading by themselves at 
their desks, and IS_ indicate they do not). Do this for all items on 
the inventory. 

Subtract "Dislike" responses from "Like" responses for each 
item and enter the plus or minus weight in the third column next to 
each item.(i. e. , Dislikes subtracted from 1£ .Likes produces a mi- 
nus weight for this item). 

Each item on the Master Inventory has a letter (A, B, or C) 
associated with it. Within each inventory category (activities, mate- 
rials, and interaction preferences), add the number of items of each 
type which have received plus weights and enter that figure under the 
corresponding Total Number of Items column on the inventory sum- 
mary. This should be done for all A, B, and C type items in each 
inventory category. 

DON'T 

Classroom Activities LIKE LIKE _L WEIGHT 

B -reading by myself at my desk 
A -reading out loud 

B -working by myself at my desk ~ “ “ 

B -working with other kids “ ‘ “ 

A -listening to the teacher talk “ “ 

A -answering the teacher's questions ------- - 

A -watching teacher explain things at' — 

the black board 
B -writing 

A -doing problems at the black board ~ — - 

A -taking tests 

. B -taking care of pets and plants ~ ~~ “ " 

B -having contests with other kids ~ ~~ 

B -playing games ~ * 

C -playing with toys ~ “ 

C -painting and drawing 

B- singing ““ ~ ” 

B -dancing “ 

C -listening to music ------- - — - 

B -doing experiments 

C -building things 

B -watching movies ‘ 

B -giving reports in front of the class “ ~ 



Materials and Media 



A -School Books 
reading 
spelling 
arithmetic 
language 
science 
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Master Student-Preference Inventory - 2 



A -Work Books 
reading 
arithmetic 
B -Story Books 

B -Magazines and Comic Books 
B -Slides 

B-Tape Recorder 
B-Re cords 
C-Toys 
B -Games 

C - Crayons ' and Paints 
B -Paper and Pencil 
A -Movies 

C -Animals and Plants 
B -Pictures 
B -Blackboard 
B -Bulletin Board 
A-Television 
C -Musical Instruments 
-Other 



mmm 






DON’T 
LIKE LIKE 






- WEIGHT 




l 

V 






Wavs of Doing Things in Class 



A -answering question when teacher calls on me 
C- shouting out the answer without being called on 
A -saying an answer when other kids say it at the 
same time 

B-not answering a question at all 
-getting help from the teacher 

B -raising my hand and asking teacher question 
B -raising my hand for teacher to come help 
me at my desk 

A-going to teacher's desk to get help 
B -getting help from other kids 
C -working or playing by myself 
B -working or playing with a few other kids and 

1 6 ^ ell G 

C -working or playing with a few other kids and 
no teacher 

C -working or playing with one other kid 



: 
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Master Student Preference Inventory - 3 



DON’T 

LIKE LIKE ± WEIGHT 



B -working or playing only with the teacher 
C -helping other kids 

A -working in front of the class at the blackboard 
B -sitting with other people in a circle or around 
a table 

B -sitting at my desk all the time 
C -working and playing in different parts of the 
room at different times 

C -going to different places in the school or outside 
the school to do different things 
A -working or playing with the same kids all the time 
C -working or playing with different kids different 
times 



Student Goals 

Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a 2 
in the blank space next to the goal. If you think a goal is not very impor- 
tant, mark it 0. If you think a goal is sort of important, but not one of 
the most important ones, give it a score of L 

I want to stay in school until I graduate from high school 

I want to stay in school until I am old enough to leave 
even though I may not graduate from high school 

‘ When I get out of school, I want to: 

get a job right away 

go into a vocational training program . . 

go to college for four years 

go to college for more than four years to become 
something like a doctor or a lawyer . 

live near home 

live far away from home 



STUDENT PREFERENCE INVENTORY SUMMARY 

(Elementary School Level) 

Under the Total Number of Items column in each category, enter 
the number of items of each type which have received plus weights on 
the master inventory. Multiply this number by the given weight for each 
type item and enter this figure in the Total Weight column. Do this for 
each type item in each category. 

Add the three figures in thetotal weight colutnn in each inventory 
category to get the Average Score for that category. Enter this figure 
in the space marked Average Score. 

In the last section of the Inventory Summary, add the three Average 
Scores for each area and divide by three (the number of areas) to get a 
Total Average Score. The Total Average Score will be described A, B, or 
C indicating student preferences for directive, mixed directive and non- 
directive, or non-directive instructional styles. The letter describing stu- 
dent instructional preferences should be entered on the Student -Teacher 
Match Chart on page 50. This will later be compared with the findings of 
the Teacher Instructional Strategy to determine the degree of student and 
teacher match. * 

Materials 



Total average number of A materials 

B 

C 





Total i 
# of 
Items 


W eight 
/item 

Total 

Weight 






x +25 ! = 






x 0 |= 0 






x -25 = 






1 



Average Score 



Each A material carries a weight of +25 
B 0 

C -25 

If the average materials score falls between + 50, the students 
tend to prefer mixed directive and non-directive materials. 

If the' average materials score falls above +50, the students 
tend to prefer direct materials. 

If the. average materials score falls below -50, the students 



tend to prefer non-direct materials. 
Activities 


Total 
# bf 
Items 


Weight/ 

Item 


[ 

i 

Total 

Weight 


Total average number of A 




x +16. 5 


S 


B 




x 0 


= 0 


C 




x -25 


— 











Average Score 



Each A activity carries a weight of +16. 5 
B 0 

C -25 

If the average activities score falls between + 50, students 
tend to prefer mixed directive and non-directive activities. 

If the average activities score falls above +50, students tend 
to prefer directive activities. 



If the average activities score falls below -50, students tend 
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Student Preference Inventory Summary (Elementary) 



Interaction Preferences 

Total average number of A preferences 

B 

C 

Each A preference carries a weight of +20 
B 0 

C -12.5 
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x +20 

x 0 |= 0 

x -12.5!= 



Average Score 



If the average interaction preference score falls between +50, 
students tend to prefer mixed directive and non-directive interaction. 

If the average interaction preference score falls above +50, 
students prefer directive interaction. 

If the average interaction preference score falls below -50, 
students tend to prefer non-directive inter abfcion. 



TOTAL AVERAGE SCORE: 



Materials 

Activities 

Interaction 

TOTAL 



/3 = 



TOTAL AVERAGE SCORE 



If Total Average Score falls between +50: A 
If Total Average Score falls above .+50: B 

If Total Average Score falls below .'-50: C 
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Student Preference Inventory (Secondary School Students) 

Please read through the following lists of classroom activities, 
materials, and ways of behaving in class. Mark all of the things you 
like by putting an "X" beside them in the LIKE column. Mark all of 
the things you don't like by putting an "X" beside them in the DON'T 
LIKE column. If there are some things you neither like nor dislike, 
you don't have to mark them at all. 



Classroom Activities ! 

"" * "- 1 — • 

I 

-listening t;o the teacher talk j 
-answering teacher's questions 
-reading out loud 
-reading to myself ' 

-doing problems on the blackboard 
-doing problems or exercises 
-writing compositons or papeirs 
-doing lab experiments j 

-watching the teacher do experiments 
-watching teacher demonstrate problems 
at the blackboard * 

f « 

-taking tests j 

-doing research i 

-playing games or having contests in class 
-singing ! 

l-dr awing or painting j 

-making things in home economics or shop 
-listening to music j 

-watching movies or television in class 
-having discussions in class 
-giving reports in front of the class 



DON'T 
LIKE “LIKE 



Mate rials and Media 

- ■■ 



,-textbooks 

-workbooks 

-library books 

-pictures 

-magazines 

-newspapers 

-slides 
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Student Preference Inventory 



DON'T 
LIKE LIKE 



(cont. ) 



-movies 

-tape recorder 

-records 

-art materials 

-musical instruments 

-paper and pencil 

-plants and animals 

-television 

-games 

-shop equipment 
.-lab equipment ! 

.-business machines j 

f-home economics facilities i 
, -other ! 



Interaction Preferences 



i ' 



-answering question when teacher calls on me 
-shouting out the answer without being called on 
-saying an answer when otheir kids say it at the 
same time j 

-not answering a question at jail 
-getting help from the teache.r 

B -raising my hand and ajsking teacher question 
B -raising my hand for teacher to come help 
me at my desk j 

A-going to teacher's desk to get help 
-getting help from other kids; 

-working or playing by myselJ 
-working or playing with a few other kids and 
the teacher j 

-working or playing with a feiw other kids and 
no teacher 

-working or playing with one) other kid 
-working or playing only with the teacher 
-helping other kids | 

-working in front of the class at the blackboard 
-sitting with other people iri a circle or around 
a table ; j 

-sitting at my desk all the time 
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Student Preference Inventory (cont. ) 



DON'T 
LIKE LIKE 



••working and playing in different parts of the 
room at different times 

•going to different places injthe school or outside 
the school to do different things 

-working or playing with the same kids all the time 
-working or playing with different kids different 
1 times i 



I 

t 

: 

J 

i 
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Student Goals 

n i n \ ■ mmm ■ ■ ■ ■■ ■■ ' j 

Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a Z_ 
in the blank space next to the goal. If you think a goal is not very impor 
tant, mark it 0. If you think a goal is sort of important, but not one of 
the most important ones, give it a score of 1_. 

j 

i 

\ 

j 

I want to stay in school until I graduate from high school 

I want to stay in school until I am old enough to leave 
even though I may not graduate from high school 

| 

When I get out of school, I want to: 

i 

get a job right away j 

go into a vocational training program 

go to college for lour years; 

go to College for more ^han four years tp become 

something like a doctor or a lawyer 

live near home 

live far away from homje 11 . 
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Master S tudent Preference Inventory (Secondary School Students) 



Enter total class results 
column (i.e. , 10 students indicate 
their desks, ancf 15 indicate they 
the inventory. 



on 



Subtract ’’Dislike” resp 
item and enter the plus or minup 
each item. (i. e. , 15 Dislikes su 
nus weight for this item). 



Each item on the Master 
associated with it. Within each 
rials, and interaction prefer enc 



corresponding Total Number of 
mary. This should be done for 
inventory category. 

Classroom Activities 



for each item under the appropriate 
they like reading by themselves at 
do not) . Do this for all items on 



ses from ’’Like” responses for each 
weight in the third column next to 
ibtracted from 1<0 Likes produces a mi’ 



Inventory has a letter (A, B, or C) 
inventory category (activities, mate- 
es), add the number of items of each 



type which have received plus weights and enter that figure under the 



Items column on the inventory sum- 
all A, B, and C type items in each 



1 ; 



DON'T 



H&E gtKE 1 WEIGHT 



A -listening to the teacher talk 
A -answering teacher's questions 
A -reading out loud 
B -reading to myself 
A -doing problems on the blackboard 
A -doing problems or exercises 
B -writing compositons or papers 
B -doing lab experiments 
A -watching the teacher do experiments 
A -watching teacher demonstrate problems 
at the blackboard 
A -taking tests 
B -doing research 

B -playing games or having contests in class 
B -singing 

C -drawing or painting 

B -making things in home economics or shop 
C -listening to music 

B -watching movies or television in class 
C -having discussions in class 
B -giving reports in front of the class 



Materials and Media 

A -textbooks 
A -workbooks 
B -library books „ 

B -pictures 
B -magazines 
B -newspapers 
B - slides 
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Master Student Preference Inventory - 2 



DON'T 
LIKE LIKE 



WEIGHT 



+ 



A -movies 
B-tape recorder 
B -records 
C-art materials 
C -musical instruments 
B-paper and pencil 
C -plants and animals 
A -television 
B -games 

B-shop equipment 
B-lab equipment 
A -business machines 
B-home economics facilities 
-other 



Interaction Preferences 



A -answering question when teacher calls on me 
C- shouting out the answer without being called on 
A -saying an answer when other kids say it at the 
same time 

B-not answering a question at all 
-getting help from the teacher 

B -raising my hand and asking teacher question 
B -raising my hand for teacher to come help 
me at my desk 

A-going to teacher's desk to get help 
B -getting help from other kids 
C -working or playing by myself 
B -working or playing with a few other kid.s and 
the teacher 

C -working or playing with a few other kids and 
no teacher 

C -working or playing with one other kid 
B -working or playing only with the teacher 
C -helping other kids 

A -working in front of the class at the blackboard 
B -sitting with other people in a circle or around 
a table 

B -sitting at my desk all the time 
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Master Student Preference Inventory - 3 



DON'T 
LIKE LIKE 



- WEIGHT 



C -working and playing in different parts of the 
room at different times 

C -going to different places in the school or outside 
the school to do different things 
A -working or playing with the same kids all the time 
C -working or playing with different kids different 
times 



Student Goals 



Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a 2 _ 
in the blank space next to the goal. If you think a goal is not very impor- 
tant, mark it 0. If you think a goal is sort of important, but not one of 
the most important ones, give it a score of 1_. 



I want to stay in school until I graduate from high school 

I want to stay in school until I am old enough to leave 
even though I may not graduate from high school 

When I get out of school, I want to: 

get a job right away 

go into a vocational training program 

go to college for four years 

go to College for more than four years to become 
something like a doctor or a lawyer 
live near home 
live far away from home 



o 



24- 151 



STUDENT PREFERENCE INVENTORY SUMMARY 

(Secondary School Level) 

i • 

Under the Total Numberl of Items column in each category, enter 
the number of items of each type which have received plus weights on 
the master inventory. Multiply! this number by the given weight for each 
type item and enter this figure in the Total Weight column. Do this for 
each type item in each category. 

Add the three figures in thetoial weight colutnn in each inventory 
category to get the Average Score for that category. Enter this figure 
in the space marked Average Score. 

In the last section of the Inventory Summary, add the three Average 
Scores for each area and divide by three (the number of areas) to get a 
Total Average Score. The Total Average Score will be described A, B, or 
C indicating student preferences for directive, mixed directive and non- 
directive, on non-directive instructional styles. The letter describing stu- 
dent instructional preferences should be entered on the Student -Teacher ' 
Match Chart on page 50. This will later be compared with the findings of 
the Teacher Instructional Strategy to determine the 
teacher match. " 

Materials 



Total average number of A materials 

B 

C 

Each A material carries a weight of +20 
B 0 

C -33 



o 

tL 



# of 
Items 


Weight, 

Item 

j 


l 

Total 

Weightj 

l 

1 




x +20 






x 0 


= 0 




x -33 











Average Score 



If the average materials score falls between +50, «• students tend 
to prefer mixed directional and non-directional activites. 

If the average materials score falls above +50, students prefer 
directional materials. 



If the average materials score falls below -50, students prefer 
non-directional materials. 



Activities 



Total average number of A activities 

B 

C 



So | 



Average Score 



+* 

■S a 

•H d) 

<D +> 



x +12.5 
x 0 
x -33. 3 



£ 
(u *H 
■8j® 

EH £ 



0 




Each A activity carries a weight of +12. 5 
B 0 

C -33 

If the . average activities score falls between +50, the students 
preferences are mixed directional. 

If the average activities score falls above +50, the students 
prefer directive activities. 

If the average activities score falls below -50, the students 
prefer non-directional activities. 
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Student Preference Inventory Summary (Secondary) 



Interaction Preferences 



Total average number of A preferences 



B 

C 



2 





Total 
# of 
Items 


Weight/ 

Item 


r t 

j Total 

i Weight 

i 

! 






x +20 
x 0 
x-12.5 


11 




o 

H 




11 

i 


. 


* 





Each A preference carries a weight of +20 Average Score 

c -12.5 



If the. average interaction preference score falls between +50, 
students tend to prefer mixed directive and non-directive interaction. 

.If the average interaction preference score falls above +50, 
students prefer directive interaction. 

If the average interaction preference score falls below -50, 
students prefer non-directive interaction. 



TOTAL AVERAGE SCORE: 



Materials ___ ___ 

Activitie s . 

Interaction 

TOTAL /3 



TOTAL AVERAGE SCORE 



If Total Average Score falls between +50: A 
If Total Average Score falls above +50: B 

If Total Average Score falls below -50: C 
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Teacher Instructional Strategy 



The five major components of the Teacher Instructional Strategy 
are: Goals, Direction, Structure, Activation, and Evaluation. Having the 
teacher describe his strategy is a good way of getting him to think about 
what he is trying to do and how he plans to do it. The strategy descirption 
will be compared with die Student Preference I nventory to determine degree 
of student -teacher match. 

The teacher describes his strategy through a questionnaire. Ele- 
mentary school teachers and secondary school tea c hers who work in more 
than one subject area should describe their instructional strategies for 
each subject area. 

The teacher should define short-range goals (for the school year) 
across four general areas: academic skills, cognitive skills, social skills, and 
motivation. These categories are not rigid and mutually exclusive. They 
simply ' indicate the spectrum of things about which the teacher should be 
thinking. 



v 




Generally, academic skill goals refer to the simple operations a 
student should be able to perform at each grade level. Cognitive goals refer 
more to the concepts and analytical skills that a student should acquire at 
each grade level. To fill out this part of the strategy description, the teacher 
should refer to the state standards as well as the standards published by 
text book writers or curriculum. However, the teacher should not limit himself 
to outside standards but should be encouraged to add or adapt goals of his own 
wherever relevant. 

Social goals refer to how the teacher would like the students to inter- 
act in class (both among themselves and with him), and to his desires for stu- 
dent deportment. 

^Outline of Teacher Instructional Strategy adapted from Bar -Yam, Miriam 
Westreick, The Interaction of Instructional Strategies with Students' Charac- 
teristics . Unpublished Thesis, Graduate School of Education, Harvard Uni- 
versity, 1968. 
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Teacher goals for student motivation could include such things as 
helping students to show more iniative (speaking out more in class, etc. ), 
to display more originality in their work, to do higher quality work, and to 
decrease student absences and tardiness, etc. 

All of the short-range goals should be defined specifcally so that the 
teacher can easily measureprogrebS toward goal achievement. A teacher 
may wish that his * students become well rounded individuals. In spite of the 
good intention of this desire, it is difficult to measure student progress in this 
direction unless the teacher defines very clearly all of the elements of well- 
roundedness and measures student progress for each. 

Long range goals refer to teachers’ desires for the students after 
they leave school,. These will be more general and are not intended for 
evaluating student progress but rather for comparing congruityof student and 

teacher long-range objectives. A teacher may wish that his students will 
find steady employment immediately upon graduating from high school, while 
his students indicate a desire to go on to college and train for professional 
careers. The teacher's lower expectations for her students could affect student 
motivation and in turn quality of student performance in school, and even whether 
or not a student remains in school. 

Direction: This section of the strategy description identifies whether 

or not direction comes primarily from the teacher or from the students. Chances 
are the direction will be mixed. The instrument will help the evaluator identify 
under what circumstances the students or the teacher control the direction of 
the class, what the teacher relies on for direction, and how the teacher interacts 
with sources of direction outside herself. 
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Structure: The information collected in this section of the 



strategy description will help the evaluator determine if the teacher 
prefers to run a tightly or loosely structured class. If his instructional 
style varies, the instrument will help the evaluator determine under which 
circumstances he uses which style and who or what is most influential in 
getting him to change styles. 

Activation : This section identifies who--teacher or student- -initiates 

activities and under what circumstances. It also collects information on 
who or what influences teacher’s choice of activities, which activities the 
teacher uses most often, which materials the teacher uses in class activities, 
and the teacher's interaction preferences. 

The section on Evaluation identifies who is responsible for evaluating 
student performance in the class, evaluation criteria, and their relative 
importance as components of the student's grades. 



How to Use the Teacher Instructional Strategy : 

The Teacher Instructional Strategy Questionnaire (page 31) 
should be filled out by the teacher at approximately the same time 
as the students fill out the Preference Inventory. Give the teacher 
a copy of the questionnaire as well as the description of the strategy 
on the preceding pages. The teacher should fill out the questionnaire 
privately and should be allowed enough time to give thoughtful consi- 
deration to his responses. It will probably take about two hours for 
the teacher to do this. 

The results of the Teacher Instructional Strategy will be com- 
pared with the results of the Student Preference Inventory to determine 
the degree of student -teacher match. Results of the Teacher Instruc- 
tional Strategy should be entered by the evaluator on the Teacher In- 
structional Strategy Summary (page 41). Directions for doing this are 
on the Summary Form. 



30-157 



o 

eric: 
















Teacher Instructional Strategy Questionnaire 



Name : 

Grade level: 
Subject: 



Short-range goals: 

On the following chart, please define your goals for this year across 
the general areas of academic skills, cognitive skills, social skills, and moti- 
vation, . These categories are not necessarily rigid and mutually exclusive. They 
simply indicate the spectrum of things about which you should be thinking* 

Generally, academic skills goals refer to the simple operations a stu- 
dent should be able to perform at each grade level. 

Cognitive goals refer more to the concepts and analytical skills that 
a student should acquire at each grade level. To fill out this part of the 
questionnaire, refer to state standards for curriculum coverage as well as 
to the standards published by the text book authors or curriculum designers in 
the area in which you are teaching. You need not limit yourself to these standards, 
and are encouraged to add or adapt goals of your own wherever relevant. 

Social goals refer to how you would like your students to interact- - 
both among themselves and with you --and to your desires for student deportment 
in general. 

Motivation goals should include such things as getting students to show 
more initiative (speaking out more in class, etc. ), displaying more originality 
in their work, motivating students to do better quality work, and decreasing student 
absences and tardiness. 
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Teacher Instructional Strategy, continued 



Long-Range Goals : 

Please read over the following list of long-range goals. Rate the 
goals you think are the highest priority with a 2 . Rate the middle priority 
goals with a ^.5 and rate the lowest priority goals with a 0. 

Preparing students to get jobs immediately after high school 

Preparing students to enter vocational training programs 

Preparing a few students to go on to college 

Preparing students for highly prof es sional jobs (doctors, 
lawyers, engineers, etc.) 

Preparing students to live successfully on the reservation 
Preparing students to integrate with Angl© culture 



Teacher Questionnaire : 

, . . Th ® Allowing questionnaire asks several questions about your style 

0 f i n !‘ rUCtl0n ; The results of this questionnaire will later be compared 
with the results of the Student Preference Inventory filled out by your stu- 
'^ entS ,‘ Th e comparison will indicate how well your instructional style is 
matched with the instructional preferences of your students. Allow your - 

f,fl ™ ^ a \ h0m : t0 fiU OUt the questionnaire so that you can give thought- 

ful consideration to your responses. 8 



Instructional Style 



o 

ERIC 



Please check the box or blank spaces beside the items which most 
closely describe your instructional style. If you select more than one item, 
please rank order your selections. You may choose up to three items. 

1. Direction: 



1.1 I provide the direction for this course 



10 30 50 80 100 %of the time 



If the answer falls within middle range of spectrum, please check 
circumstances under which you provide direction. 

When I really want to get something done 

When students are unmotivated and are progressing too slowly 

When students are jumping ahead too fast or illogically 

Only at the beginning of new study units 
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Teacher Instructional Strategy, continued 



1.2 Students provide the direction for this course 



-ERIC 
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If answer falls within middle range of spectrum, please check cir- 
cumstances under which students provide direction 

When I have covered all the necessary work and we have 
some extra time 

When they are motivated and excited by an idea and I want 
to tap their excitement 

When I am frustrated with trying to get them to do what I 
want them to do 

When I am worried about pushing themlhrough the work too 
quickly " 

Other 



1. 3 For direction I rely most heavily on 

kLy own ideas about how the course should be taught 
The text book or curriculum outline 
The ideas of my supervisor 
The ideas of other teachers 

Ideas I have read about in journals and books 



Other 



1.4 
1. 5 
1.6 

1.7 

1.8 



!l0 j 30 1 50 I 80 1 lOOj ffo of the time I use the curriculum outline only as 
a reference for doing things my own way 



10 3 0| 50 80 |100 % of the time I diverge from the text book or curriculum 



outline. 



1 o | 30l 50l 80 llOOl % of the time I criticize myself or the text book in front 



of the students 



1 0 1 3 0 1 50 j 80l IPO! % of the time I allow students to criticize me or the 
textbook 



10 30 



50 80 1 100 % of the time I encourage students to criticize me or 



the text book. 
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Teacher Instructional Strategy, continued 
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2 . Structure : 

Please check the item or items (up to three items) which are most 
descriptive of the way you work. If some are irrelevant, please cross them 
out. If you check more than one item, please rank order your selections from 
most often to least often used style. 

2 a l In each class I try to present information and concepts in a 

clear and logical order 

I generally try to follow a logical progression of information 
and concepts for the whole course, but structure my day-to- 
day teaching more loosely depending on the mood of the stu- 
dents 

I try to present information and concepts within a subject area 
to the students as they need them or seem especially receptive 
to them even though that means I may not know exactly what 
I'll be teaching from one week to the next 

I try to present information and concepts across all subject 
areas to the students as they need them or seem especially 
receptive to them even though that means we may start discussing 
social studies in the middle of what started out to be a science 
lesson 

Other 



2.2 When I change from a tightly structured style to a more loosely 
structured one, it is usually because: 

I am bored 

I am tired of planning everything out very carefully 

My supervisor has suggested that I change styles 

I have been inspired to change from having talked to or 
observed other teachers 

I have been inspired to change from having read something 
in a book or journal 

The students seemed bored 

The students get very excited about an idea that s not included 
in the lesson plan and I want to help them understand it while 
their motivation is high 
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Teacher Instructional Strategy, continued 



(2.2 continued) 

The students are progressing too slowly 

The students are progressing too quickly 

I just can't be that organized all the time 

Other 

2. 3 When I change from a loosely structured style to a more tightly 

structured one it is usually because 

The students are progressing slowly 

The students are progressing too quickly 

I am having trouble keeping the class in order 

My supervisor has suggested that I change styles 

I have been inspired to change from having talked to or 

observed another teacher 

I have been inspired to change from having read something 

in a book or journal 

I found I need to work within a less ambiguous framework 

Other 

3'. Activation : 

3. 1 I initiate class activities 10 30 50 80 100 % of the time. 

r i r r~i — i 

If answer falls within middle range of spectrum, please check 
circumstances under which you initiate activities 

When I really want to get something done 

When students are sluggish and I want to get them busy 

When students are unruly, and I want to settly them down 

When we have a visitor in class, and I want to make sure 

everything runs smoothly 

Other 



Teacher Instructional Strategy, continued 



3.2 Students initiate class activities 10 30 50 80. 100 % of the time. - 

i i i i i f I 

If answer falls within middle range of spectrum, please check 
circumstances under which s tudents intiate activities. , 

When I have covered all the necessary work, and we have 

some extra time. 1 

On special occasions like right before vacations 

When they have been especially good and I want to reward i 

them 

When they are really excited about doing something and I 

want to take advantage of ths ir motivation 

When I am tired or bored 

When I think they have a better idea about what to do than 

I have 

Othe r 

3.3 I get most of my ideas for activities from 

Teachers' guide 

Supervisor 

myself 

* 

Other teachers 

Books and articles 

The kids 

Other 

3.4 I usually plan activities that will 

Best help me teach the concepts and, skills within the subject area 

To meet the needs of the slower students s 

To meet the needs of the brighter students 

To meet the needs of the average students 

That will keep the class orderly and manageable 

Be novel for the students and excite their curiosity 

Other 3 
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Teacher Instructional Strategy, continued 



3. 5 When more than one activity is going on in the class at the same 
time, it is usually because 

I have more than one grade in the same room 

I want to keep the rest of the kids busy while I'm giving 

my attention to a small group within the class 

I am trying to tailor activities to meet the needs of fetu- 
dents of different achievement levels within the class 

Different groups of students like to do different things, and 
I want to take advantage of their motivation 

I simply find it exciting to have a couple of activities going 

on at one time 

Other 

3. 6 When I teach this course I usually like to 
Work with the whole class at once 

Divide the class into several small groups and work with one 

group at a time 

Walk around the class and help each student personally 

Get the students to help each other 

Sit at my desk while the students are working and have them 

come to me for help 

Other 

3. 7 When I ask the class questions I usually like to 

designate a student to anwer a question before I ask it 

Let any student call out the answer 

Ask a question and call on whoever raises their hand 

Ask a question and have the students respond en masse 

Ask a question and designate a student to answer it whether 

he raises his hand or not 
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Teacher Instructional Strategy, continued 



3. 8 Please rank order the three activities you use most in teaching this 
course. 

Lecturing or talking in front of the class 

Question and answer sessions with the whole class 

Group discussion with the whole class 

Breaking class into several small discussion groups 

Breaking class into several small work groups 



Have kids do programmed work at desk (workbooks, written 
exercises, etc. ) 

Have kids do non -programmed work at desks (write essay, etc. 

Have kids work at the black board while rest of class watches 

Demonstrating experiments for whole group 

Supervising student, lab work (science lab, shop, home ec) 

Having students read aloud to rest of class 

Having students read to themselves at their desks 

Having contests and playing games 

Other 
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I; 3# 9 Please read through the following list of classroom materials and 

I media. Rank order the three items you use most. 
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Elementary School 



Secondary School 



text book 
workbook 
story books 

magazines and comic books 

movies 

slides 

tape recorder 
records 
toys 
games 

art materials 
paper and pencil 
blocks 
pictures 

animals, plants, other 
natural things 
black board 
bulletin board 
television 

musical instruments 
lab equipment 
other 




text book 
workbook 
library books 

reference 

^fiction 

nonfiction 

pictures 

magazines 

newspapers 

slides 

movies 

tape recorder 

records 

art materials 

musical instruments 
paper and pencil 
plants, animals, other 
natural things 
television 
games 

shop equipment 
lab equipment 
business machines 
home ec facilities 
sports equipment 
other 
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Teacher Instructional Strategy, continued 



4, Evaluation 



4. 1 I am responsible for evaluation of student performance 
10 30 50 80 100 % of the time. 



4.2 Please read through the following list of student evaluation factors. 
Rank order the three items you use most when you are making up 
student grades. 

student performance on periodic tests 

- standardized 

that I make up 

correctness of answers on programmed work (done in class 

or as homework) 



content only of non-programmed work 
correctness of form, neatness, etc., of student work 
originality of student work 
oral performance in class 
student effort 

student deportment in class 

Other 
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Teacher Instructional Strategy Summary 



Item 



LI 



1.2 



_L_3_ 
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1.5 



1.6 
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Description 
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Z2 ZZ2 



Subtotal Average( < one'*' e ) 



B 



£ 



Structure 



Activation 



2.1 



2.2 
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3. 1 
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zzzzz 



Subtotal Average (^one^) 



A 



B 



3.2 



3.3 



3*4 



3.5 
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3.7 
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Subtotal Average (^one^ e ) 



A 



B 



Evaluation 



4.1 
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z 
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Z Z 



Subtotal Average (^jne^ 6 ) 



A 



B 



C 



TOTAL RESULTS 
(Circle one) 



B 



Directions: 



The teacher's responses to the Teacher Instructional Strategy Questionnaire 
should be recorded on this Summary. Use the attached Master Questionnaire to 
identify the type of instructional style (A, B, or C) described by the teacher in his 
response to each item. 

Some of the questions on the Teacher Instructional Strategy Questionnaire 
are two-part questions. If the teacher answers the first part of the question in a 
certain way, he is referred to the second part of the question. For example, 
question 1.1: "I provide direction for this course 10%, 30%, 50%, 80%, 100% of 
the time. " Responses at either end of the percentage scale are clearly A or C 
type responses. A teacher response of 50% would seem to indicate that his di- 
rection is mixed. However, before determining this, teacher responses to the 
second part of the question should be checked. Here the teacher may indicate 



^W4l«Pl!nmP9PPimpilRg|PlP!iinPf^^ 



that he provides direction "when I really want to get something done, " which 
is described as an A type response and indicates that when the teacher is 
really involved in the business of teaching, which is the issue here, he tends 
to be directive. This would make his response to question 1.1 an A type re- 
sponse. 

On other items in the Teacher Instructional Strategy, the teacher may 
select more than one response. Multiple answers are rank ordered. If all 
of the teacher’s responses are of the same type, there is no problem. 

In multiple response questions where the teacher has selected 
more than one response typ^ each priority response receives a rank 
weight and each type response receives a factor weight. The rank 
weights are ^_5 for highest priority response, ,_3 for second priority 
response, and ,_2 for all lower priority responses. The factor weights 
are l_ for A type responses, 2^for.B type responses, and 3_ for C type 
responses. 

To determine the type response for the whole question, multi- 
ply the factor weights of the responses by their rank weights and add 
the products. The response type for the whole question is the type 
which has the factor weight closest to this sum. 

For example: in question 2.2, the teacher is asked to indicate 
under what circumstances he changes from a tightly structured to a 
more loosely structured style. The teacher may select the following 
responses in the following rank order: 

1. Students are progressing too slowly 

2. I have been inspired to change from having talked 
to or observed other teachers 

3. I have been inspired to change from having read 
something in a book or journal 

His highest priority (rank weight .5) is an A type response 
(factor weight 1). His second priority (rank weight . 3) is a B type 
response (factor weight 2), His third priority response (rank weight .2) 
is also a B type (factor weight . 5) 

.5(1) + .3(2) +.2(2) = .5 + .6 + .4 = 1.5 
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This figure comes closest to 2, which is the factor weight of 
B type responses. His response for the total question is then a B type 
response. 
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TEACHER INSTRUCTIONAL STRATEGY 

MASTER FORM 



'•i 



To the User: 



Each item on the Teacher Instructional Strategy Questionnaire is 
described here as A (indicative of directive instructional style), B (indica- 
tive of mixed directive and non-directive instructional style), or C (indica- 
tive of non-directive instructional style). When filling out the Teacher In- 
structional Strategy Summary, refer to this Master to identify the type of 
instructional style described by the teacher in his response to each item. 






Instructional Style 

Please check the box or blank spaces beside the items which most 
closely describe your instructional style. 



1. Direction: 




10 30 50 



1. 1 I provide the direction for this course | f 



80 100 % of the time | 



C C B A A 

If answer falls within middle range of spectrum, please check 
circumstances under which you provide direction. 

A w hen I really want to get something done 

A w hen students are unmotivated and are progressing too slowly 
A w hen students are jumping ahead too fast or illogically 
B o nly at the beginning of new study units 
othe r : 



TO 30 50 



1.2 Students provide the direction for 'this course 



I 



80 100% ofth 

| tim 



b 

$ 



A 



If answer falls within the middle range of spectrum, please check 
circumstances under which students provide direction. 



A w hen I have covered all the necessary work and we have 
some extra time 

C w hen they are motivated and excited by an idea and I want 
to tap their excitement 

A w hen I am frustrated with trying to get them to do what I 
want them to 

C w hen I am worried about pushing them through the work 
too quickly 
other : 



1 






I 






1. 3 For direction, I rely most heavily on 






If answer falls within the middle range of spectrum, please check 
circumstances under which students provide direction. 

B my own ideas about how the course should be taught 



A the text book or curriculum outline 



1 



A t he ideas of my supervisor 
B the ideas of other teachers 



I 



C i deas I have read about in journals and books 
other: 
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100% 


00 

• 

H 






1 




_J 




A 


A 


B 


B 


c. 



as a reference for doing thins my own way. 



of the time I diverge from the text book or 
curriculum outline. 



of the time I criticize myself or the text book 



or the text book,. 



of the time I encourage students to critize my- 
self or the text book. 



2. Structure: 



Please check the item or items which are most descriptive of the way you 
work. If some are irrelevant, please cross them out. If you check more 
than one item, please rank order your selections from most often to least 
often used style. 



2.1 



A In each class I try to present information and concepts in a clear 
and logical order. 

B I generally try to follow a logical progression of information and 
concepts for the whole course, but structure my day-to-day 
teaching more loosely depending on the mood of the students. 

C I try to present information and concepts within a subject area to 
the students as they need them or seem especially receptive to 
them, even though that means I may not know exactly what I'll be 
teaching from one week to the next. 

C I try to present information and concepts across all subject areas 
to the students as they need them or seem especially receptive to 
them even though that means we may start discussing social studies 
in the middle of what started out to be a science lesson. 



2.2 



When I change from a tightly structured style to a more loosely struc- 
tured style, it is usually because 



A I am bored 

A I am tired of planning everything out very carefully 
A my supervisior has suggested I change styles 

B I have been inspired to change from having talked to or observed 
other teachers 

B I have been inspired to change from having read something in a 
book or journal 
C the students seemed bored 



C the students get very excited about an idea that's not included in 
the lesson plan and I want to help them understand it while their 
naotivation is high 
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2. 2 continued. ... 

A the students are progressing too slowly 
A t he students are progressing too quickly 
B I just can't he that organized all the time 
other: 

2. 3 When I change from a loosely structured style to a. more tightly 
structured one, it is usually because 

the students are progressing too slowly 

A t he students are progressing too quickly 
A I am having trouble keeping order in the class 
A my supervisor has suggested that I change styles 
B I have been inspired to change from having talked to or observed 
. another teacher 

B I have been inspired to change because of something I have read 
A I found I need to work within a less ambiguous framework 
other: 



3. 



Activation : 

Please check the item or items which are most descriptive of the way you 
work. If some are irrelevant, please cross them out. If you check more 
than one item, please rank order your selections from most often to least 
often used styles. 

I Q 30 50 80 10.0 ( ^ j |o f the time 



3 # 1 x initiate class activities 



TT 



I 






If answer falls within middle range of spectrum, please check 
circumstances under which you initiate activities. 



A when I really want to get something done 
B when students are sluggish and I want them to get busy 
"A when students are unruly and I want to settle them down 
A when we have a visitor in class and I wan*: to make sure 
everything runs smoothly 

other: • 

10 30 50 80 100% of the time 

3.2 Students initiate class activites f I 7 I _ _l ~ 1 . < 

A A B C C 

If answer falls within middle range of spectrum, please check 
circumstances under which students initiate activities. 

A when I have covered all the necessary w~>rk and we have 
some extra time 

A on special occasions like right before vacations 
B w hen they have been especially good and I want to reward them 
C when they are really excited about doing something and I want 
to take advantage of their motivation 
A when I am tired or bored 

C when I think they have a better idea about what to do than I have 
other: 



ti 
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A teacher's guide 
B supervisor 

B m yself 

B other teachers 

B book and articles 

C t he kids 
othe r : 



3.4 I usually plan activities that will 

A best help me teach the concepts and skills within the subject area 

B best meet the needs of the slower students 

B best meet the needs of the brighter students 

B best meet the needs of the average students 

A b est help me keep the class orderly and manageable 
C b e novel for the students and excite their curiosity 
other: 
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3. 5 When more than one activity is going on in the class at the same time, 
it is usually because: 

A I have more than one grade in the same room 

A I want to keep the rest of the kids busy while I'm giving my 
attention to a small group within the class 

B I am trying to tailor activities to meet the needs of students 

of different achievement levels within the class 

C different groups of students like to do different things and I 

want to take advantage of their motivation 

C I simply find it exciting to have a couple of activities going 

on at one time, 
other: 



3.6 When I teach this course, I usually like to 

A w ork with the whole class at once 

B d ivide the class into several small groups and work with one 
group at a time 

B w alk around the class and help each student personally 

C g et the students to help each other 

A sit at my desk while the students are working and have them 

come to me for help 

other: 



3. 7 When I ask the class questions, I usually like to 

A d e signate a student to answer a question before I ask it 
C r l et any student call out the answer 

J3 ask a question and call on whoever raises their hand 

A ask a question and have the students respond en masse 

A ask a question and designate a student to answer it whether 

he raises his hand or not 
othe r : 
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3. 8 Please rank order the three activities you use most often in teaching 
this course. 

A l ecturing or talking in front of the class 
. A q uestion and answer sessions with the whole class 
C g roup discussion with the whole class 
B b reaking class into several small discussion groups 
B b reaking class into several small -work groups 

A h ave kids do programmed work at desk (workbooks, written exercises, etc 
B h ave kids do non -programmed work at desk (write essay, etc.) 

A h ave kids work at the black board while rest of class watches 
A demonstrate experiments for whole group 

B s upervise student lab work (science lab, shop, home economics) 

A h ave students read aloud to rest of class 
B h ave students read to themselves at their desks 
B h ave contests and play games 
other: 



3.9 Please read through the following list of classroom materials and 
media. Rank order the three items you use most. 



Elementary School 
text book 



^ work book 

story books 

B m agazines and comic books 
A m ovies 
slides 

tape recorder 

records 

C toys 

_B games 

C art materials 

_B paper and pencil 

_C blocks 

JB pictures 



B 



animals, plants, and other natural 

things 

black board 



_B bulletin board 

A television 

C musical instruments 



J3 laboratory equipment 

other: 



Secondary School 

A t ext book 
A w ork book 
library books 
A r eference 
B 1 f iction 
.3 n onfiction 
B p ictures 
B m agazine s 
3 n ew sp ap e r s 
B s lides 
A m ovies 
B t ape recorder 
B r ecords 
C a rt materials 
C m usical instruments 
C p lants, animals, and other 
natural things 
A t elevision 
B g ames 

B shop equipment 

B l aboratory equipment 
■ A b usiness machines 
B h ome economics facilities 
B s ports equipment 
B p aper and pencil 

other: 
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4. Evaluation: 



4. 1 

4.2 



I am responsible for evaluating student performance 



10 30 



C C 



$ 

* 

I 

50 80 100% 

— E : I _lj 

B A A ; 



Please read through the following list of student evaluation \ 

actors. Rank order the three items you use most when 1 

making up student grades. 

student performance on periodic tests 

A standardized 
A t hat I made up 

^correctness of answers on programmed work (done in class or as 
homework) 

B content only of non -prog rammed work 
-jL c orrectness of form, neatness, etc. of student work 
C o riginality of student work 
B o ral performance in class 
C student effort 
A s tudent deportment in class 
other : 
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Implications of Student -Teacher Match 

Degree of student -teacher match on instructional style preferences 
should be considered in relation to student performance both in terms of 
achievement and motivation. 

If teacher and students appear to be well -matched and student achieve 

ment is satisfactory then there is no problem. 

Poor student achievement occurring in the context of a good student - 
teacher match implies that there may be problems in the way the teacher 
is formulating his classroom program in terms of curriculum coverage or 
problems in the way -he is implementing his instructional strategy- -the 

way he is actually behaving in class. 

The results of the classroom observation and the activities time 
budget (see Determining Degree of Curriculum Coverage, p. 7J>J should 
be checked. If both of these are satisfactory, then the problem probably 
lies not in the activities the teacher uses in his- classroom program but 
in the content of the lessons. 

All teachers need to make trade-offs between meeting student 
motivational needs and meeting the substantive requirements of the curri- 
culum. The kind of situation being discussed here is one in which student 
• motivational needs are perhaps being met at the cost of these substantive 
requirements. The evaluator should discuss lesson content with the 
teacher to determine if he is actually covering substantive material at 

the rate suggested by the curriculum designer. If he isn't, he should 

be urged to do so. He.* probably will be able to do this at little cost in terms 
of student motivation, as the good student -teacher match indicates that the 
teacher is already sensitive to student motivational needs. These sen- 
sitivities will guide the teacher in reformulating her classroom program. 



If the teacher is satisfactorily covering substantive content, then 
student achievement problems probably lie outside the teacher’s control 
in the curriculum or in another area of the school program. 

If student -teacher match is fair or poor and student achievement 
is good the teacher is apparently making up for disagreements between 
his- and the students’ instructional style in some other way. 

If student -teacher match is fair or poor and student achievement 
is unsatisfactory the problem could lie in part in the teacher’s sensitivity 
to student motivational needs, though other model outputs should be checked 
to identify possible problems in other areas. The evaluator and the teacher 
should go over the average results of the Student Preference Inventory to 
see if there are activities, materials or interaction patterns that are pleas - 
ing to the students that the teacher could incorporate into his teaching style 
without sacrificing too much in terms of curriculum coverage. 

Problems in student -teacher .match could also stem from the 
teacher having to deal with more than one clearly defined type of student. 

In that case, the teacher can stick to one strategy that seems to be best 
for some (and this maybe a majority) of the students and either write- 
off the rest or hope that his strategy-if not the best for all students -is 
not completely wrong for any of them. Or the teacher can employ a mixed 
strategy that works for both the majority of the students in his - class and 
one or two deviation groups. In judging match of teacher and student 
types it will be useful to remember that brighter, more aggressive stud- 
ents can work better within a directive instructional style than slower, 
more passive students can within a nondirective instructional style. 
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The other major point of comparison between teacher instructional 
strategy and student preferences is in the area of long-range goals. If 
there is significant incongruity between teacher and student long-range 
goals, which is actually a basic disagreement about why the students are 
in school and what they are supposed to accomplish there, then there is 
going to be trouble. 

If the teacher wants the students to accomplish more or other 
than the students want to, there will either be a strengthening of resist- 
ance to teacher instruction or an increase of anxiety about not being able 
to perform up to the teachers expectations. Either one will result in less 
than optimal student performance. 

If the teacher’s expectations are lower than the students, it could 
dampen student motivation and again result in poor student performance. 
The issues raised through an analysis of goal congruence not only provide 
useful information for the evaluator but provide the basis for dialogue 
between evaluator and teacher and>more importantly, between student and 
teacher. 

Other Suggested Uses of the Teacher Instructional Strategy 

The teacher instructional strategy is essentially a model of a 
teacher’s instructional style. As such, it can be used in two additional 
ways;. It can be evaluated as a model in terms of internal coherency and 
consistency; and it can be checked against what the teacher is actually 
doing in the classroom. Is the model an accurate description of the way 
the teacher actually behaves in class? 
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Proceeding from the general description of the teacher's instruct- 
ional strategy as directive, non-directive, or mixed, the evaluator could 
also analyze the strategy to see if this definition holds across all parts 
of the strategy --goals, direction, structure, activation, and evaluation. 

The evaluator is essentially asking of the strategy, "Does it hang together? 

Is it whole ? " 

If the answer is no, it means there is probably some confusion 
in the teacher's mind about what he is trying to do. A confused teacher 
is not atn effective one. 

For example : If the teacher wants to allow students to determine 
direction for the class and yet he initiates all classroom activities, the 
students will never get a chance to exercise the responsibility the teacher 
expects of them. The teacher will be disappointed; the students will be 
confused, perhaps even frustrated and resentful. 

Or: If the teacher doesn't collect evaluative data consistent with his 
goals, the students are likely to misperceive his expectations for them 
and perform along lines very different from what the teacher desires. 

In his eyes, this would be poor student performance. Another conseq- 
uence of inconsistency between goals and evaluative factors is that the 
teacher will never have the information He needs to measure his own 
effectiveness in terms of progress toward goal achievement. If the teacher 

can't do this, then he is performing poorly. 

The evaluator might also look to see if the strategy fits within 
minimum stimulation and maximum manageability thresholds. Given 
consistency, is the strategy so limited and simple-minded in its aims and 
design that instruction becomes a bore for both the students and the teacher? 
Or is the teacher trying to do so many things at once through a strategy 
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so complicated that it is impossible for him to manage it, to translate it 
into action in the classroom. 

The teacher instructional strategy also provides one perspective 
from which to observe and evaluate teacher behavior in the classroom. 

It is not the only perspective. The evaluator will also want to see how 
what the teacher does effects what the students do and make judgments 
on the quality of that interaction. The concern here is whether or not 
the instructional strategy really models actual instruction. If it doesn't, 
then there is either confusion in the teacher's mind about what his- strategy 
really is or about how to implement his strategy in the classroom. 

Either way the result is less than effective teaching. Using the instruct- 
ional strategy as one way of looking at teacher performance will help 
confirm or cancel out teacher confusion as a source of ineffective instruct- 
ion. 

All of these considerations could provide the basis for informal 
talks between the evaluator and the teacher - or for discussion among 
the instructional staff in faculty meetings. 
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Classroom Observation Guide 



The classroom observation guide is designed to help the evaluator 
critically observe some aspects of student- teacher interaction in the class- 
room. The guide covers the major categories of teacher in class behavior, 
classroom activities, teacher questions, teacher involvement, student 
response and student attention. 

Some sections of the Observation Guide have been adapted from 
Ben M. Harris and Kenneth E. McIntyre's A Manual for Observation and 
Analyzing Classroom Instruction . An observation guide based on the manual 
developed by Harris and McIntyre was used in research conducted by Abt As - 
sociates Inc. for the Bureau of Indian Affairs. The guide included here has 
been modified and refined on the basis of experience the designers had with 
the original survey instrument. 



The guide is in the form of a checklist describing various teacher 
and student behaviors. Each behavior has associated with it a percentile 
ranking. The evaluator should consider each behavior and check in the 
appropriate box the frequency of occurence of that particular behavior. 

The estimates are approximate as it is difficult for one evaluator to des- 
cribe these behaviors more specifically on the basis of one class observ- 
ation. If the evaluator plans to observe a particular teacher several times 
over the school year or if observation is carried out by a team of observers 
rather than an individual, it is suggested that the evaluator alter the percentile 
ranking scale to achieve a finer description of behavior frequency. This would 
simply involve adding more percentile categories to the existing scale. 

The categories of teacher behavior covered in the guide are: Pre- 
senting, Directing, Supporting and As sis ting, and Discouraging. 

Presenting behavior covers all teacher behavior that presents con- 
tent to the students. This can happen in teacher lectures or demonstrations 
or in teacher answers to student questions. This section of the guide will 
help the evaluator identify how much information the teacher gives the student 
and the comprehensibility of that information. 



... _ : 1 \ j v # v. * * 

* Extension Teaching and Field Service Bureau, University of Texas, 1964. 
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Directing behavior refers to directions the teacher gives to the 
students about how they are supposed to perform. What needs to be distin- 
guished here is whether or not the teacher simply establishes a frame- 
work for student problem-solving efforts or solves their problems for them 
by over -directing their efforts. 

Supporting and assisting behavior refers to all behaviors both 
active and responsive by which teacher supports or assists student problem- 
solving efforts. Does he take the students seriously by listening to them 
and answering their questions? Does he express confidence in the students? 
Does he help students to handle their problems by assuming that they are 
problems and allowing students second chances and access to assistance? 
Does he give students feedback on their efforts? 

The sectionon discouraging behavior considers teacher efforts 
to curtail student behavior, through ignoring students, scolding them, 
negative criticism, etc. The evaluator should be alert to whether or not 
the teacher is discouraging student misbehavior in the classroom or 
student initiative. Does he cut them off every time they raise what seems 
to be irrelevant issues, or does he listen to them on the assumption that 
students may perceive relevance where he does not? Is he willing to 
learn new ideas from the students? 

The last section on teacher behavior considers the mix of all types 
of teacher behaviors. If most of a teacher's behavior falls disproportion- 
ately within one category it is a bad sign. A high proportion of directing 
or discouraging behavior prevents the student from assuming any respon- 
sibility for his own learning and from exploring new avenues of thought, or 
new metaphorical relationships between old ones. A high proportion of 
presenting behavior could over- saturate the student with information to 
the extent that he never gets a chance to use the information in problem- 
solving or is never responsible for finding information on his own. On 
the other hand, if the teacher gets involved in excessive amounts of support- 
ing or assisting behavior the students may never learn the variety of infor- 
mation and skills they are expected to learn at each grade level. 

Observing teacher behavior is a subtle process demanding a high 
degree of sensitivity on the part of the observer. The teacher is at all 
times cueing the students not just by what he says but by his 1 demeanor 
and all of his movements. The observer should be alert to the signals 
that the teacher is sending out to the students on all levels and through 
all modes of expression. 
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Subjective response to the teacher on the part of an outsider (any- 
one not the teacher) is the crux of the teacher involvement scale. How 
absorbed in students and subject matter does the teacher seem to be? If 
he appears distracted to the observer, chances are he appears distracted 
to the students as well, even though the teacher may not be aware of 
distraction. Students may respond to his distraction by feeling that if 
the class or lesson does not seem to be worth the teachers' involvement, 
it is not worth their 's either. So it is important to get some information 
on how the teacher demons tr at es y through her involvement^ the value of the 
content, and people ;he is dealing with. 

Student Involvement 



Student involvement in the classroom process is approached from 
three directions: Objective evidence of student attention to teacher, other 
students and classwork; class actiyities scaled from those requiring no 
student participation and those requiring a high degree of student parti- 
cipation; and patterns of student response to teacher questions. 

Student Attention 



The student attention scale involves taking a quick count of the 
number of students who appear to be attentive under three different circum- 
stances: When. the teacher is talking, when other students are talking, or 
when the students are working at a task. The evaluator also wants to know 
the approximate length of the attention span of those students who are attent- 
ive. One can usually expect about 10% to 20% of the students in a class to 
be unattentive under different circumstances (the students who don't listen 
when the teacher is talking are not necessarily the same students who day- 
dream or talk when they should be doing workbook exercises). One can 
also expect student attention to drop over time if class activities are not 
varied or are not stimulating enough to sustain student interest. The student 
involvement scale helps the evaluator collect data on size of class population 
who are attentive and the length of their attention span. 







Classroom Activities 

The classroom activities checklist will help the evaluator estimate 
how well the teacher plans classroom activities. This is one of the major 
tests of a good teacher, for in choosing and scheduling classroom activities 
the teacher is involved in a fairly sophisticated kind of guerilla warfare. 

He. wants to plan activities that will excite student interest and seduce 
students into being involved. However, student involvement alone is irrele- 
vant unless the activities are loaded with enough instruction in content and 
skills to adequately meet curriculum requirements. More will be said 
about curriculum requirements below. For the time being we are concerned 
with student involvement. 

There are two elements to be considered in evaluating activities 
in terms of student involvement: Variety of activities and degree of student 
participation required by different types of activities. In the best of all 
possible student and teacher worlds, it would be possible for a teacher 
to maintain student involvement using only activities demanding a low level 
student participation. Lectures, films, demonstration experiments , story 
reading, all involve a low degree of student participation (compared to 
students doing problems in their workbooks); but if the teacher varies these 
activities often enough, there is a good chance of the students not being 
bored. Activities such as lab work, games, student essay writing demand 
a higher degree of participation on the part of each student and could main- 
tain student involvement over longer periods of time with less variety. 

In the real world it is best to look for both variety and high level of parti- 
cipation, though level of participation is less critical when variety is high, 
and variety is less critical when level of participation is high. 

As mentioned above, classroom activities are also important from 
the curriculum coverage point of view. The major output of the classroom 
activities checklist will be a measurement of degree of curriculum cover- 
age (see p.76). The evaluator will estimate approximate percentages of 
class time devoted to different kinds of activities. These percentages will 
be compared with standard activities time budgets to estimate how well 
the teacher is exposing students to content and skill-loaded activities. 
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Student Response 

Two categories of student response are considered: Student response 
to teacher questions and the questions and comments students raise on their 
own initiative. 

Students generally respond to teacher questions in three different 
ways: When they are individually called upon by the teacher to answer quest- 
ions; mass response of the whole class in response to teacher cues; and call- 
ing out answers without being personally designated by the teacher. 

By designating specific students to answer questions the teacher is 
placing responsibility on individuals for performing- -is challenging them 
personally. This is a useful way for teachers to get information from indiv- 
idual students to use for evaluation and in planning future lessons. However, 
it should be remembered that individual questioning and probing is done to 
the exclusion of the rest of the class. If the teacher spends too much time 
in obtaining student response by individual designation, she may be unknow- 
ingly encouraging students to focus on content and classroom processes 
only when they are called upon. 

The kinds of information students are giving the teacher in mass 
responses are usually simple facts that the students have memorized. This 
type of student response is useful for brief class drills to review information 
taught previously. If most of the student response is given in this manner, 
it is a sign that the teacher is treating subject matter content superficially. 

When students call out answers without being designated by the teacher 
it is usually a sign of student initiative and involvement in the classroom 
process. If this happens frequently note if the same students are doing all 
of the answering. If they are, it could mean that the teacher is more con- 
cerned with getting through a lesson than with teaching lesson content to the 
clas s. 

Pupil Questions 

Pupil questions and comments are one of the few easily observable 
and quantifiable variables for identifying and measuring student initiative. 



A question is an aggressive, outreaching act, expectant of response and 
implying a desire for interaction. Questions are highly significant for these 
reasons no matter how simple-minded they are. Frequency, regardless 
of content, is important. 

Content of questions is also important. If most of students questions 
and comments are about how to carry out a task it is usually an indication 
that teacher directions have been unclear. Questions and comments about 
the substantive content of the lesson indicate student involvement in the 
subject matter and the learning process. Questions and comments about 
topics not related to the subject matter could imply that the students are 
bored or over-saturated with subject matter and are creating novelty or 
distraction for themselves; or they could imply that the students are making 
metaphorial relationships between subject matter and other areas of know- 
ledge or experience. This is what learning is about. Alertness and sen- 
sitivity on the part of the observer are important for distinguishing between 
the two. 

Teacher Questions 



Five different types of teacher questions are considered. These 
range generally from superficial to more penetrating questions. Each 
different level of question involves the student on a deeper cognitive level. 
Recognition and recall questions require only that the student remember 
rather simple bits of information or identify the correct answer from alter- 
natives given to him by the teacher or presented to him in the curriculum 
materials. Demonstration of skill questions require the student to demon- 
strate his understanding of information by performing skills. Comprehen- 
sion questions require students to demonstrate their understanding of 
information and process by explaining them or identifying examples or 
illustrations of the issues under consideration. Analysis questions usually 
require the student to abstract information from a problem about which 
he presumably knows nothing or very little. Opinion or attitude questions 
require the student to respond with his own feelings or ideas about a pro- 
blem. All the information comes from the student; he is not remembering, 
identifying, or analyzing information from any source other than himself. 
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Teacher's name 

Subject being taught 
Grade level 



CLASSROOM OBSERVATION GUIDE 



Teacher Behavior 
1. Presenting 



1 . 1 



1.2 

1.3 



Of the total time students and teacher spend talking in the class 
the teacher is talking ^ 10 ^ 30 ^ 50 ^ 80 ^ lOOq^ of the time 

- IQ 30 50 80 . 100% of the time 



percent of teacher talk related to 
subject matter o? work 
percent of teacher talk not related 
to subject matter or work 



2 . 



3. 



Compr ehens ibility 

1.4 teacher presents information in logical 
step by step sequence 

1. 5 teacher uses words that seem to be be- 
yond student comprehension 

1.6 teacher talks too loudly 

1.7 teacher talks too softly 

1. 8 teacher talks too fast 

1. 9 teacher talks too slowly 

1. 10 teacher uses expressions or examples 

relevant to student age or socio- cultural 
background 




Directing Behavior 



Teachers directions are: 

2. 1 simple directions about what materials 
to use and guidelines for working 
2. 2 detailed step by step directions about 
how to do work 



10 30 50 80 100% of the time 



Supporting and Assisting Behavior 

3. 1 teacher looks at students when they 
are talking 

3.2 teacher answers student questions 

3. 3 when student doesn't answer question 
teacher helps him try to answer 

During lesson: 

3.4 teacher expresses confidence in student 
ability to do work 

3.5 teacher encourages students' problem- 
solving efforts 

3. 6 asks for student questions regarding 
understanding of material or task 

3.7 recognizes student problem-solving 
efforts 
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While students are working, teacher: 

3. 8 walks around room checking student 
work and helping students out 

3. 9 allows students to come to her desk or 
to ask questions from their desks about 
work 

3. 10 allows students to help each other 

3. 11 does not allow students access to any 
assistance 

When lesson is completed, teacher: 

3. 12 gives or promises feedback on work 
done (i.e. comments on problems 
they had, says when she'll return 
work, etc. ) 

3.13 rewards student efforts (i.e. displays 
student work, gives kids extra play- 
time, etc. ) 




Discouraging Behavior 



When teacher discourages students she is trying to: 

, , 10 30 50 

4. 1 put an end to misbehavior 

4.2 avoid presentation or discussion 
of non- subject matter topics 

4. 3 avoid presentation or discussion 

of ideas about subject matter topics 
that differ from her own 



m 



100% of the time 



Total Teacher Behavior 



Please indicate percentage breakdown of total teacher behavior across 
the following categories; 

„ . 10 30 50 80 100% of the time 

5. 1 presenting 

5.2 directing 

5. 3 supporting and assisting 
5.4 discouraging 



Teacher Involvement 



Please indicate percent of total class time teacher seems: 

10 30 50 80 

6 . 1 involved 

6.2 s emi - involved 

6. 3 distracted 

6.4 uninvolved 



100% of the time 



Student Attention 



10 30 50 80 100% of the time 

7. 1 When teacher is talking 

7.2 are attentive 

7.3 When students are talking 

7.4 are attentive 

7.5 When students are working 

7.6 are attentive 






percent of the students 
percent of the time 
percent of the students 
percent of the time 
percent of the students 
percent of the time 
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8. Teacher Questions 
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8 . 1 



8.2 



8.3 



8.4 

8.5 



8 . 6 

8.7 

8.8 



10 30 50 80 100% 




















































10 


30 


50 


80 


100% 



of the time 

of teachers questions require students to 
recognize or recall correct answer 
of teachers questions' require students to 
demonstrate skills 

of teachers questions require students to 
demonstrate their comprehension of ideas 
or concepts 

of teachers questions require students to 
analyze a problem or idea 
of teachers questions require students to 
express their own opinions or attitudes 



of the time teacher designates individual 

student to answer question 

of the time teacher designates the whole 

group to answer question 

of the time teacher designates no one to 

answer question 



9. Student Response 



9.1 

9.2 

9.3 

9.4 



Students respond to teacher questions; 

only when called on 
without being called on 
en masse 

students talk without being 
asked questions 

Students questions and comments are about: 

how to carry out task 
substantive content o£ lesson 
topics not related to subject matter 



10 30 50 80 100% of the time 



9.5 

9.6 

9.7 



10. Classroom Activities 



Please indicate percent' of total class time taken up by the following types 

■ . * m | • m • *1**% i i 



of activities : 

^teacher lecture or demonstration 
-individual students reading aloud 
-teacher -student question and answer 
session 
-discussion 

-students reading at desk 
-students doing lab or shop work 
•^students working in small groups 
(games, discussions, etc. ) 

-students doing programmed work 
at desk (i. e. workbook exercises, 
etc. ) 

-students doing nonprogrammed 
work at desk (i.e. essay writing, 
etc. ) 
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Evaluating Teacher Behavior 



Data from the classroom observation form should be entered on 
the Teacher Behavior /Student Response Bar Graph. Accompanying the 
blank bar graph form is a completed bar graph suggesting standards for 
evaluation and a set of guidelines for interpreting both the standards and 
the data collected from classroom observation. 

The standards and guidelines are based on the experience of expert 
teachers and research, including classroom observations carried out in 
approximately 150 Indian classroom. The evaluator is encouraged to 
adapt the standards in light of his own experience or knowledge of teach- 
ing. In fact, a discussion of evaluative standards for teacher classroom 
behavior would be an excellent project for the administrative and instruct- 
ional staffs of any school involved in teacher evaluation. 
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1 , j Between 60-80% of the total class talk time is usually taken 

up by the teacher. ‘ If the teacher is talking more than 80% of the total talk 
time he probably isn’t allowing the students enough time to ask questions, 
to develop their verbal skills, or to give the teacher the kinds of verbal 
information he needs for student evaluation. If the teacher is talking less 
than approximately 30% of the time it could indicate that he is neither giv- 
ing them enough information nor the verbal assistance they need to learn. 

1 , 2 and 1 , 3 If less than 80% of the teacher’s talk is related to subject 
matter or class work the teacher is probably not adequately covering the 
substantive content of the curriculum. 

1.4 If the teacher is not presenting substantive content logically 
and clearly at least 80% of the time- it will be difficult for students to under- 
stand either him or the content. This will be reflected in poor student 
achievement. 

1.5 If the teacher uses words beyond the comprehension of the 
students more than 10 % of the time the students will not know what the 
teacher is talking about, no matter how logical his presentation is. 

1.6 _ i. 9 Voice level and rate of speech are critical factors in teacher 
comprehensibility. If these factors are unsatisfactory more than 10% of 
the time the students may become distracted from the content of what the 
teacher is saying and become more involved in the way the teacher talks. 

1.10 Comprehensibility of content will be enhanced if the teacher 

uses expressions or examples relevant to the age of his" students or their 
socio- cultural background. If a teacher does this less than 30% of the time 
he may not be giving much attention to making the subject matter meaning- 
ful for the students. 



* Flanders, Ned A., Teacher Information, Pupil Attitudes, and Achievement , 
USHEW OEO-CRP, 397, University of Minnesota, I960. 
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2. 1 and 2. 2 | If less than 80% of a teacher's directions to students are any- 
more than general guidelines for carrying out classworkthen chances are 
the teacher is solving the students’ problems for them rather than establish- 
ing a framework within which they can solve problems themselves. 
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3 . 1 Teachers should look at students when they are talking all 

the time. The 80% standard provides the teacher a certain amount of lee- 
way for routine and unavoidable distractions. If the teacher doesn't look 
at the students more than 20 % of the time it implies that she is neither listen- 
ing to them nor taking them seriously, two things any teacher should do. 
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3.2 When a student asks a question it is usually a sign that he is 

trying to learn or understand something. If the teacher doesn't respond, 
the student may become frustrated and stop trying to learn. 

3 . 3 This item deals with the value the teacher places on second 

effort. If a student performs unsatisfactorily the first time'through a pro- 
blem, he should be encouraged to try again. However, a teacher can 
spend so much time assisting and encouraging individual students that she 
ignores the rest of the class. The 50-80% thresholds on this item should 
allow the teacher to encourage individual, students without losing the atten- 
tion or interest of the rest of the class. 

3.4 - 3.7 These items all deal with the teacher giving students the 

moral support they need to learn. This support is as important as the 
quality. or comprehensibility. of the information the teacher gives the students. 
If the teacher gives students support less than 30% of the time, student 
motivation will probably be low and student achievement will reflect that 
low motivation. 

3 . 8 When a teacher walks around the room checking on and help- 
ing students he is doing a number of things: he is giving individual 

attention to students; he- is aggressively seeking out student problems; 
and he is making it less threatening for a student to gain access to assist- 
ance (a student may feel embarrassed or ashamed to raise his hand to get 
assistance and publicly admit that he is having difficulties). The teacher 

should assist students in these ways at least 50% of the total time he is 
assisting students. The upper threshold on this item is established some- 

70 -198 
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what arbitrarily. But the evaluator should be aware that if the teacher spends 
too much time giving attention to individual students he is doing so at some 
cost to the group as a whole. 

3 # q By allowing students to come to his desk for help or to raise 

questions from their desks, the teacher is allowing students access to assist- 
ance but he is doing so more passively than in item 3. 8, and he is requir- 
ing the students to take more initiative in seeking assistance. This is fine 
as long as it is not the only access a student has to teacher assistance. 30% 
seems a reasonable threshold for this item. 

3 , io By allowing students to help each other, the teacher is freeing 

herself to do other work and is allowing a kind of peer teaching to take place. 
Peer teaching is one effective way for students to learn. The 10% threshold 
on this item does not mean that if a teacher allows students to help each 
other more than 10% of the time he is performing poorly. Instead it indicates 
that a teacher might try this teaching technique at least 10% of the time. 

3 b ii There are some classroom situations in which a teacher may 

want to find out what a student can do on his own without any assistance. A 
30% threshold has been allowed for this. If a teacher does not allow students 
access to assistance more than 30% of the time, he may be seriously con- 
straining student efforts to learn. 

12 Feedback in the form of teacher comments or grades on 

student work is essential for students to know how they are doing. If the 
teacher is not providing this feed back at least 80% of the time ? students 
will have little basis for either feeling satisfied with the work they are doing 
or for trying to improve the quality of their woik • 

3 ^ 13 Teacher rewards for student efforts are one way the teacher 

encourages students to continue working. Teachers should somehow reward 
student efforts at least 50% of the time. 
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If any more than 10-30% of a teacher's total discouraging 



behavior is spent discouraging other than student misb ehavior it could 
indicate two things: the teacher may be discouraging student initiative 

by discouraging the presentation or discussion of ideas about subject 
matter topics that differ from his own; or the students are presenting 
a lot of nonsubject matter topics implying the teacher is presenting them 
with too much information for them to handle or that the lesson is uninter- 
esting to them. 






IlI 5 » 4 These four items describe the total mix of teacher behavior. 

If teacher behavior falls disproportionately within one or two categories, 
it is a sign that he is not giving the students very much behavioral 
variety to which they can respond. If most of a teacher’s behavior is 
presenting behavioi^ ^ means that the students are being required to 
function as passive receivers. This does not allow them opportunity to 
take some responsibility for their own learning or to develop initiative. 

Or if a teacher's behavior falls disproportionately within the supporting 
and assisting category, coverage of substantive content is likely to be slow. 

AiJ — : — 6^4 Ideally, the teacher should be totally involved with the lesson 

and the students 100% of the time. The 10-30% thresholds on the three less 
than totally involved categories allow a margin for teacher mood, unforeseen 
distractions, and interruptions, etc. 



7.1 - 7.6 



If less than 80% of the students are attentive less than 80% 



of the time, it is a sign that the students may be bored or over -saturated with 
the content of the lesson or the behavior of whoever is talking. When this 
happens something, (the content, the classroom activities, teaching techni- 
ques, or the teacher's or students' behavior) should be changed. 

JLA. more than 30% of a teacher's questions are recognition 

or recall questions, it may be a sign of superficial teaching and consequently 
superficial student learning. 
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The lower threshold here is more critical than the upper one. 
Demonstration of skill questions requires students to perform skills related 
to curriculum content. If a student is not asked to perform in this manner 
often enough, neither the teacher nor the student will know what the student 
can actually do. The teacher needs this information for evaluating students 
and for ongoing formulation of hi? classroom program. The student needs 
this information so he knows where he needs to do more work. While the 
upper threshold is not rigid, a very high percentage of demonstration of skill 
questions could mean that the teacher is more interested in getting students 
to perform mechanical operations than being able to analyze or thoroughly 
understand the content with which they are dealing. 



8. 3 and 8. 4 Again in these items the lower thresholds are the important 
ones. The upper threshold can be higher, but the evaluator should be aware 
that it will be difficult for students to handle the performance responsibilities 
implied in these type s of que stions without having parallel responsibility for 
carrying out their ownlearning. If teacher presenting and directing behavior 
are high, if the classroom activities are not ones that involve a relatively 
high level of student participation, the student probably has not been encour- 
aged to assume this responsibility for his own learning. 



8. 5 Questions of this type really require students to relate sub- 

ject matter to their own experiences and feelings. This type of question is 
one way the teacher has of helping make the subject matter meaningful to 
the student. The lower threshold is the important one though a high level 
of opinion and attitude questions could mean student attitudes are'being "d^alt 
with at the cost of covering the substantive content of the curriculum. 



8. 6 By designating individual students to answer questions, the 

teacher creates a framework within which he can be sensitive to individual 
students both for evaluative and motivational purposes. He is also placing 
a high degree of responsibility for performing on individual students. Some 
of the implications of this have been discussed under item 8. 3. If the teacher 
spends too much time obtaining student response by individual designation, 
he. may be unknowingly encouraging the rest of the class to focus on content 
and classroom processes only when they are called upon. 
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8. 7 This kind of questioning, where the teacher poses a question 

to the whole class then designates individuals to respond, is more inclusive 
of the group as a whole. However, a high proportion of group designated 
questions may indicate that the teacher is only seeking answers quickly from 
a few students who can provide them. If this is so, then the teacher would 
seem to be more interested in moving smoothly through a pre-planned lesson 
than in really finding out what all the students in the class know. 

8. 8 When a teacher designates no one to answer a question, .he 

is creating a great deal of ambiguity about who is to perform. If his students 
are aggressive they will probably be able to handle this ambiguity and may 
even find it stimulating. However, if the students are more passive and 
hesitant they will probably not be able to respond well under this type of 
questioning. The evaluator should interpret the upper threshold on this 
type of questioning with these considerations in mind. 



in 



9. 1 If students respond to the teacher’s questions only when called 

upon^it could mean that student initiative and motivation are low or that the 
teachers instructional style is so directive that it is constraining initiative 
and motivation. 



9.2 When students respond without being called on it is a sign 

of high motivation and/or initiative. If this occurs much less than 30% of 
the time, the evaluator should look for indications in other areas of the 
teachers behavior that he is constraining these factors. If -he is not, then 
the teacher should be encouraged to try to find new ways of developing 
these qualities in .his students. 



9. 3 The kinds of information students are giving the teacher in 

mass responses are usually simple facts that the students have memorized. 
This type of student response is useful for brief class drills to review infor- 
mation taught previously. If more than 10% of the student response is given 
in this manner, it is probably a sign that the teacher is treating subject 
matter content superficially. 



9.4 



The interpretation of this item would be the same as 9.2. 



I 
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9,5 If more than 30% of student questions are about how to carry 



out a task, it could mean two things: 1) teacher directions were unclear in 

the first place; 2) students don't ask many questions and when they do, they 
ar _ about how to carry out tasks -- low level of student questions could im- 
ply that students are not involved in the subject matter or classroom process. 

9*6 If less than 50% of student questions and comments are about 

substantive content^it is a sign that the students are probably not too involved 
in the subject matter and/or the classroom process. 



9* 7 There are two somewhat opposing implications of a high pro- 

portion of student questions about apparently non-subject matter related 
topics: The students could be bored or over -saturated with subject matter 
and are creating novelty or distraction for themselves. Or they could be 
making metaphorical connections between subject matter and other areas of 
knowledge or experience. The former is a bad sign, the latter a good one. 
The evaluator should interpret this item with these considerations in mind. 
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Degree of Curriculum Coverage 

Activities on the Classroom Observation Chart are ranged generally from 
those involving no or a low degree of student participation to those 
involving a high degree or total student participation. 

Adequate curriculum coverage in each major subject area generally 
requires that students are involved in different kinds of activities from each 
of these participation levels. Included here is a table of typical time budgets 
for different kinds of activities in each major curriculum area. These are 
based on the experience of teachers and education specialists used as re- 
sources in the design of this model. 

The user may want to develop his own time budget table, using the 
teachers in his school as consultants. 

To evaluate how well the teacher is covering the curriculum, first 
check student performance (i.e. teacher grades and student achievement 
scores) in the subject area or areas in which the teacher is working. If 
performance is good, there is no problem. 

If performance is less than satisfactory, the teacher may not be pro- 
viding adequate student exposure to different types of classroom activities. 

\ • Compare the teacher’s actual activities time budget (Section 10 of the Class- 

I 

[ room Observation Guide) with either the typical activities time budget included 

I here or the time budget developed by the user. 

If the teacher’s actual time budget differs ^significantly (20 percent or 

f 

; more per category) from the typical standards, it is an indication that the 

teacher is not formulating his classroom program in such a way that students 

1 
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are adequately involved in activities at the level or levels in which the 
differences appear. 

If the teacher’s actual time budget does not differ significantly from 
the typical time budgets, it is an indication that the problem does not lie 
in classroom program formulation but rather is in the area of student -teacher 
match or the teacher's instructional style. 
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Feedback to the Teacher : 

The evaluator can either save all feedback to the teacher until the 
end of the evaluation process or he can hold discussions with the teacher 
as soon as each step in the evaluation process has been completed. The 
important point is that the teacher is told something about what has hap- 
pened to the information collected from him (through the Teacher Instruc- 
tional Strategy Questionnaire and the classroom observation) soon after it 
has been collected. This is important psychologically as well as substan- 
tively. If the entire evaluation process is carried out within a week or two , 
the evaluator can wait until everything has been completed until he talks with 
the teacher. If the evaluation is conducted over a longer period of time, the 
evaluator should speak with the teacher as soon as each successive phase of 
the process has been completed. 

However it is done, the evaluator, at some point, should go over with 
the teacher the implications of the findings of student -teacher match, the ac- 
tivities time budget (formulation of classroom program), and the classroom 
observation. This should be done in face-to-face discussions rather than 
written memoranda and reports. The level of these discussions should be 
objective, focusing on objective analysis of classroom program and teacher 
behavior and what both communicate or don't communicate to the students. 

With individual teachers or with the faculty group as a whole, the 
evaluator can work out new techniques or methods to change teacher or stu- 
dent behavior in the class. The In-Depth Evaluation Model can be used as 
a recurring instrument of evaluation to identify the impact of these program 
changes. 
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Exercising 

Two program simulations have been run through the model. One 
is the video tape classroom monitoring system (essentially an in-service 
tr ainin g technique) and the other a program which pays teachers in rela- 
tion to the achievement of their students (an incentive technique). Both 
programs are directed toward the problem of inadequate instruction. 

The incentive program is based on student achievement on stan- 
dardized tests. In a simulation, the teacher responded to it by trying to 
make subject matter more comprehensible to the students and himself 
more comprehensible as a transmitter of subject matter. The teacher's 
objective was to increase student performance, but the model shows that 
in trying to accomplish this he inhibited student involvement in the class- 
room process. Unless his students were already fairly well motivated, it 
was not likely that much increase in student performance would result. 

The video tape program regularly presents the teacher with drama- 
tic and objective examples of his own classroom behavior and that of other 
teachers in school. These include teacher comprehensibility (touched on by 
the incentive program) as well as a broad range of verbal and nonverbal be- 
haviors. As a result of this perspective, the teacher became more sensitive 
to his involvement with his students in classroom processes. . Student motiva 
tion and initiative were high under this program. Some inefficiencies of in- 
struction resulted, but did not detract seriously from student performance. 

It would appear that the two programs would complement each other 
if they were both carried out at the same time. If only one could be selected, 
the video tape program would seem to be the better choice. The problems 
generated by it would be more easily corrected than those generated by the 

incentive program. 

For the simulation, an Abt Associates staff member played the role 
of student. His responses to the student preference inventory were used in 

both program simulations. 
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Another staff member played the teacher's role, which was that of 
a "typical" BIA teacher of high school social studies. The impact of each 
program on the teacher's ideas about teaching, and on his classroom behavior, 
are described on the Teacher Instructional Strategy Questionnaire and Class- 
room Observation Guides for each program simulation. 

The completed survey forms and output summaries for each simula- 
tion follow. 
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Output Summary: Video Tape Program 

The Student -Teacher Match Chart indicates that student -teacher 
match, in terms of instructional styles, is good; it falls somewhere be- 
tween "fairly matched" and "well matched . 11 

The output for degree of curriculum coverage shows that the teach- 
er is fulfilling curriculum expectations in the formulation of his classroom 

program. 

The output for classroom observation shows that the teacher is com- 
prehensible and his mix of behavior and interaction modes good. The only 
problem indicated by the output is that the teacher may be spending too much 
time assisting individual students, at some cost to the progress of the class 

as a whole. 
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BIA EDUCATION PROGRAM DESCRIPTION 
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Problem: 



INADEQUATE TEACHING AND LACK OF CLASSROOM OBSERVA.- 



TION AND EVALUATION 



f 



•.Program Description: Video tape classroom monitoring system and inter-class 
a'nd inter - s choo! critiques: An Education Specialist would prepare a program of the 

. ^ -» -I r j _ i • i j • • _ 1 



w*** A V * ~ — - -W — — ' — — — • — — — — — XT 1. X * W 

best and worst points from each class for presentation and discussion at monthly 
faculty- administrative meetings. Tape programs would also be exchanged among 
schools' on a rotating basis, with critique forms provided for feedback purposes. 
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• ’• ' Pilot Program 


Operational Program 


What: 

• * • * * 

• * ‘ * **..*.. 
‘ * 

1 • 

/ , 

• 1 • • * 

ft— — . - 


Initiate program 5n 3 schools. 

1 s et of video tape equipment 
wouldbe supplied to each s choo' 
(If there are more than 5 0 clas s 
rooms, 2 sets of equipment 
woul.dbe supplied. ) 


Same. Expand ’program to all BIA 

% 


Where: . 

\ 

% • i 


Greasewood 
Loheman * • 

Santa Rosa Boarding 


150 BIA schools. 

• 

• 


When: 

► ’ 


September" 1969 

* «• \ * # 

t 


September 1970 

* - / 


• •How: 1 \ • . 

i • , »*•••« «* 

• 

m 


Video tapes would be made of 
several clas_s__s_es sions, in 
each class. An Ed. Spec, 
wouldbe in charge of editing 


Same. 


Schedule: 

;• v 

• 


4 * • 


#* • 




- Costs: 

• • • * * 

Personnel 


1 Ed. spec, /s.chool @ $10K = 

$30k 

• ** 

• 


Same/Ed. Spec, /sch @ lGk = 
$1,500,000 . 

* 


Facilities: 


1 room/school for storage 
and editing @\1 Ok ea. " = 30k 


1 rm/sch. for storage editing $5 

10k ea. = S1,50J,0Q0 


: * v ’ Equipment: 

s» 


$5 k/ school = 15k 


5k/schoc ’5C = $750, 000 


Other: 

•* 

TOTAL: ’ ’ 

* * • 


Supplies, processing,, etc. @ 

1 Ab / p /•"sol — * ^ Mr 


Supplies, processing, etc. @ 10k/ 
ejehv $1 c^on nnn _ 


k} h mm efr Wv — 

• .. 1 • * - * * 

$105k83-2U 


• 

1 (cost /nnniD ^ A D $5,250, 000 
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Student Preference Inventory (Secondary School Students) 



** <« * 



Please read through the following lists of classroom activities, 
materials, and ways of behaving in class. Mark all of the things you 
like by putting an "X" beside them in the LIKE column. Mark all of 
the things you don’t like by putting an ’’X" beside them in the DON’T 
ULKE column. If there are some things you neither like nor dislike, 
you don’t have to mark them at all. 



Classroom Activities 



•listening 1}o the teacher talk • 

•answering teacher’s questions 
•reading out loud | 

•reading to myself j 

•doing problems on the blackboard 
•doing problems or exercises 
■writing compositons or papers 
doing lab experiments j 

watching the teacher do experiments 
watching teacher demonstrate problems 
at the blackboard 

•I 

•taking te sts 
•doing research 
playing games or having conic sts in class 
•singing ' j 

■drawing or painting j 

making things in home economics or shop 
•listening to music j 

watching movies or television in class 
■having discussions in class 
giving reports in front of the class 



i-: 



L 



DON’T 
‘ LIKE LIKE 




X 



V % 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



X 



Materials and Media 



-textbooks 

-workbooks 

-library books 

-pictures 

-magazines 

-newspapers 

-slides 



X 



X 



X 



X 



X . 



X 



X 
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Student Preference Inventory (cont. ) 



-movies 

-tape recorder * 

-records 
-art materials 
-musical instruments 
-paper and pencil 
-plants and animals 
-television 
-games 

-shop equipment 
i-lab equipment 
I -business machines 
-home economics facilities 
-other 



i : 



DON'T 
LIKE LIKE 



X 

"x 



X 



X 




X 

■X 



X 



X 

X 



X 



Interaction Preferences 



-answering question when teacher calls on me 
-shouting out the answer without being called on 
••saying an answer when other kids say it at the 
same time j 

^not answering a question at all 
^■getting help from the teacher 

! B -raising my hand and asking teacher question 
B -raising my hand for teacher to come help 
me at my desk | 

A-going to teacher's desk to get help 
-getting help from other kids 
-working or playing by myself JJ "' 

-working or playing with a few other kids and 
the teacher j 

-working or playing with a few other kids and 
no teacher ' 

-working or playing with onei other kid 
-working or playing only with the teacher 
-helping other kids j 

-working in front of the class at the blackboard 
-sitting with other people iri a circle or' around' • 
a table ; I • • 

-sitting at my desk all the time 

* # . • . v »i j.» 



X 



X 



X 

X 



X. 



X 



X 



X 

X 



X 



X 



JL 



J L 



X 



X 



X 
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Student Preference Inventory , (cont. ) 



■ » 

-working and playing in different parts of the 
room at different times 

■going to different places in : the school or outside 
the school to do different things 



LIKE 



X 



DON'T 

LIKE 



X 



.--working or playing with the same kids all the time X 
-working or playing with different kids different 



times 



X 



Student Goals j 

< 9 

Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a 2 _ 
in the blank space next to the goal. If you think a goal is not very impor 
tant, mark it JL If you think a goal is sort of important, but not one of 

the most important ones, give it a score of JL* 

1 

.i «- 

! 

I want to stay in school until I graduate from high school 2 

i , 

I want to stay in s chool until I am old enough to leave 
even though I may not graduate from high school 

When I get out of school, I want to: 

. I 

get a job .right away ! 
go into a vocational training program 
‘ go to college for four years;- 
go to College for more than four years tp become 
something like a doctor or a lawyer 
live near home I . 

live far away from home 



0 



2 



T *- 
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STUDENT PREFERENCE INVENTORY SUMMARY 

(Secondary School Level) 

Under the Total Number! of Items column in each category, enter 
the number of items of each type which have received plus weights on 
the master inventory. Multiply thi3 number by the given weight for each 
type item and enter this figure in the Total Weight column. Do this for 
g,ach type item in each category 1 . 

I • t 

Add the three figures in thetetal weight column in each inventory 
category to get the Average Score for that category. Enter this figure 
in the space marked Average Score. 

In the last section of the Inventory Summary, add the three Average 
Scores for each area and divide by three (the number of areas) to get a 
Total Average Score. The Total Average Score will be described A, B, or 
C indicating student preferences for directive, mixed directive and non- 
directive, os non-directive instructional styles. The letter describing stu- 
dent instructional preferences should be entered on the Student-Teacher 
Match Chart on page 50. This will later be compared with the findings of 
the Teacher Instructional Strategy to determine the degree of student and 
teacher match. ~ * 



Materials 



Total average number of A materials 

B 

C 

Each A material carries a weight of +20 
B 0 

C -33 



—i 59 
a <2 £ 

+> O H 

o 

fc! t j 



+} 

Is 

H A) 
0 +» 



11 



x +20 
x " 0 
x -33 



rH 2 

3.2? 

o « 



= +80 



0 



= _i2 9. 



Average Score -19 



If the average materials score falls between +50,* students tend 
to prefer mixed directional and non -directional activites. 

If the average materials score falls above +50, students prefer 
directional materials. 
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non-directional materials. 

Activities 

•r 

-4 * 

Total average number of A activities 

B 

C 



o 



-50, 

O s 


students 

+4 

•H <1) 

0 4J 


3 prefer 

£ 

*-J bO 

Cti .H 
+» 0 


2 


x +12.5 


= +25 


7 


x 0 


= 0 


3 


x -33. 3 


= -67. 









Average Score 



-42 



Each A activity carries a weight of +12.5 
B 0 

C -33 

If the . average activities score falls between +.50, the students 
preferences are mixed directional. 

. If the average activities score falls above +50, the students 
prefer directive activities. 

If the . average activities score falls below -50, the students 
prefer non-directional activities. 
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Student Preference Inventory Summary (Secondary) 
Interaction Preferences 


T otal 
\# of 
Items 


Weight/. 

Item 


2 

rH 2 . 

o ® 

IH p- 


Total average number of A preferences 


1 


x +20 


= +20 


B ' 


6 


x 0 


= 0 


C 


5 


x -12. 5 


= -62.5 


Each A preference carries a weight of +20 
B 0 


Averag< 


2 Score 


_ 4? , „ 





C -12.5 

.If. the. average interaction preference score falls between +50, 
students tend to prefer mixed directive and non-directive interaction. 

I 

.If the average interaction preference score falls above +50, 
students prefer directive interaction. 

. If the average interaction preference score falls below -50, 
students prefer non-directive interaction. 



TOTAL AVERAGE SCORE: 

Materials -19 
Activities -42 
Interaction -42. 5 

TOTAL -103.5/ 3 = -34.5 TOTAL AVERAGE SCORE 

If Total Average Score falls between +50: A 
If Total Average Score falls above +50: B 

If Total Average Score falls below -50: C 
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Teacher Instructional Strategy, continued 



Long-Range Goals : 

Please read over the following list of long-range goals. Rate the 
goals you think are the highest priority with a 2^. Rate the middle priority 
goals with a 1_; and rate the lowest priority goals with a 0* 



Preparing students to get jobs immediately after high school 0_ 

Preparing students to enter vocational training programs 2_ 

Preparing a few students to go on to college 2_ 

Preparing students for highly profes sional jobs (doctors, 

lawyers, engineers, etc. ) 

Preparing students to live successfully on the reservation 1_ 

Preparing students tp integrate with Anglo culture — 2_ 



Teacher Questionnaire : 

The following questionnaire asks several questions about your style 
of instruction. The results of this questionnaire will later be compared 
with the results of the Student Preference Inventory filled out by your stu- 
dents. The comparison will indicate how well your instructional style is 
matched with the instructional preferences of your students. Allow your- 
self about an hour to fill out the questionnaire so that you can give thought- 
ful consideration to your responses. 



Instructional Style 

Please check the box or blank spaces beside the items which most 
closely describe your instructional style. If you select more than one item, 
please rank order your selections. You may choose up to three items. 



1. 



Direction: 



1.1 I provide the direction for this course 



10 30 .50 80 100 










X 



If the answer falls within middle range of spectrum, please check 
circumstances under which you provide direction. 



When I really want to get something done 

When students are unmotivated and are progressing too slowly 










When students are jumping ahead too fast or illogically 
Only at the beginning of new study units 
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Teacher Instructional Strategy, continued 



1.2 



Students provide the direction for this course 



10 30 


50_ 


80 


X 






n 



1UU ' 

I "1 



r of the 
5 time 



If answer falls within middle range of spectrum, please check cir 
cumstances under which students provide direction 



1 When I have covered all the necessary work and we have 
some extra time 



When they ar- motivated and excited by an idea and I want 
to tap their excitement 

When I am frustrated with trying to get them to do what I 
want them to do 



When I am worried about pushing themHirough die work too 
quickly 

Other 



1. 3 For direction I rely most heavily on 

My own ideas about how the course should be taught 

? The text book or curriculum outline 
The ideas of my supervisor 
3 The ideas of other teachers 

Ideas I have read about in journals and books 



Other 



l u 4 !un 3 oC 5 a | 8QjjL00j % of the time I use the curriculum outline only as 
a reference for doing things my own way 

I. 5 |l 5 0 1 8 0 [ 1001 % of the time I diverge from the text book or curriculum 
ouuTne. 

1 . 6 SoTftO |l Pol % of the time I criticize myself or the text book m front 

oithe students 

1.7 3 0 [5 0l 8 Oj 100l % of the time I allow students to criticize me or the 

textbook 

l m g (ffi )30l50i 80 1 1 0 Oj % of the time I encourage students to criticize me or 
tfie text book. 
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I Teacher Instructional Strategy, continued 

f. 

$ 

f * 



2. Structure : 

Please check the item or items (up to three items) which are most 
descriptive of the way you work. If some are irrelevant, please cross them, 
out* If you check more than one ite-m, please rank order your selections from 
most often to least often used style. 



I 2. 1 In each class I try to present information and concepts in a 

| clear and logical order 

i 

■ II generally try to follow a logical progression of information 

\ and concepts for the whole course, but structure my day-to- 

[ day teaching more loosely depending on the mood of the stu - 

l dents 

t 

i 

5 I try to present information and concepts within a subject area 

f to the students as they need them or seem especially receptive 

to them even though that means I may not know exactly what 
l I'll be teaching from one week to the njpxt 

[ . I try to present information and concepts across all subject 

\ areas to the students as they need them or seem especially 

[ receptive to them even though that means we may start discussing 

social studies in the middle of what started out to be, a science 
lesson 



Other 

2.2 When I change from a tightly structured style to a more loosely 
structured one, it is usually because: 

I am bored 

-- ~s* ' ~ 

I am tired of planning everything out very carefully 
My supervisor has suggested that I change styles 

1 I have been inspired to change from having talked to or 
observed other teachers 

I have been inspired to change from having read something 
~ in a book or journal 

2 The students seemed bored 

3 The students get very excited about an idea that's not included 
in the lesson plan and I want to help them understand it while 
their motivation is high 



JS 



I 



i 




I 

4 



4 

i 
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Teacher Instructional Strategy, continued 



(2.2 continued) 

The students are progressing too slowly 

The students are progressing too quickly 

I just can't be that organized all the time 
Other 

2. 3 When I change from a loosely structured style to a more tightly 

structured one it is usually because 

1 The students are progressing, slowly 

The students are progressing too quickly 

I am having trouble keeping the class in order 

My supervisor has suggested that I change styles 

2 I have been inspired to change from haVing talked to or 
observed another teacher 

I have been inspired to change from having read something . 
in a book or journal 

• i found I need to work within a less ambiguous framework 

Other 

3. Activation : 

3. 1 I initiate class activities 10 30 50 80 100 % of the time. 

[ l I -~l I T 

If answer falls within middle range of spectrum, please check 
circumstances under which you initiate activities 

When I really want to get something done 

1 When students are sluggish and I want to get them busy 

2 When students are unruly, and I want to settly them down 

When we have a visitor in class, and I want to make sure 
everything runs smoothly 

Other 
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Teacher Instructional Strategy, continued 



3.2 Students initiate class activities 10 30 50 80. 100 % of the time. 

I x | I 1 I I 

If answer falls within middle range of spectrum, please check 
circumstances under which s tudents intiate activities. : 

3 When I have covered all the necessary work, and we have 
some extra time. 

On special occasions like right before vacations 

1 When they have been especially good and I want to reward 
them 

2 When they are really excited about doing something and I 

want to take advantage of the ir motivation 

0 

When I am tired or bored 

When I think they have a better idea about what to do than 

I have 

Othe r 

3.3 I get most of my ideas for activities from 

3 Teachers’ guide 
Supervisor 

1 myself 

"" 1 1 • 

2 Other teachers 

Books and articles 

The kids 

, 

m< _ Other 

3.4 I usually plan activities that will 

1 Best help me teach the concepts and, skills within the subject area 

2 To meet the needs of the slower students 

To meet the needs of the brighter students 

3 To meet the needs of the average students 

That will keep the class orderly and manageable 

♦ 

Be novel for the students and excite their curiosity 

Other 
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Teacher Instructional Strategy, continued 





















3. 5 When more than one activity is going on in the class at the same 
time, it is usually because 

I have more than one grade in the same room . 

* * 

2 I want to keep the rest of the kids busy while I'm giving 
my attention to a small group within the class 

1 I am trying to tailor activities to meet the needs of Stu- 
dents of different achievement levels within the class 

Different groups of students like to do different things, and 

I want to take advantage of their motivation 

I simply find it exciting to have a couple of activities going 

on at one time 0 

Other 

3. 6 When I teach this course I usually like to 

1 Work with the whole class at once 

2 Divide the class into several small groups and work with one 

group at a time 

3 Walk around the class and help each student personally 

Get the students to help each other 

Sit at my desk while the students are working and have them 

come to me for help 

Other 



y 

p 



3. 



7 



| 

( 

ft 

: 



i 

I 

( 



t 

I 



When I ask the class questions I usually like to 

designate a student to anwer a question before I ask it 

2 Let any student call out the answer 

1 Ask a question and call on whoever raises their hand 
Ask a question and have the students respond en masse 

3 Ask a question and designate a student to answer it whether 
he raises his hand or not 

Other 
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Teacher Instructional Strategy, continued 

3. 8 Please rank order the'three activities you use most in teaching this 
course. 

Lecturing or talking in front of the class 

1 Question and answer sessions with the whole class 
Group discussion with the whole class 

Breaking class into several small discussion groups 
3 Breaking class into several small work groups 

2 Have kids do programmed work at desk (workbooks, written 
exercises, etc. ) 

0 

Have kids do non -programmed work at desks (write essay, etc. ) 

Have kids work at the black board while rest of class watches 
Demonstrating experiments for whole group 
Supervising student lab work (science ^ab, shop, home ec) 
Having students read aloud to rest of class 
Having students read to themselves at their desks 

Having contests and playing games 

Other 







\ 
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Teacher Instructional Strategy - continued 



3. 9 Please read through the following list of classroom materials and 
media. Rank order the three items you use most. 



Elementary School 









h 



o 

ERIC 



text book 
workbook 
story books 

magazines and comic books 

movies 

slides 

tape recorder 
records 
toys 
games 

art materials 
paper and pencil 
blocks 
pictures 

animals, plants, other 
natural things 
black board 
bulletin board 
television 

musical instruments 
lab equipment 
other 
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Secondary School 



JL 



text book 
workbook 
library books 
preference 



fiction 

nonfiction 



pictures 

magazines 

newspapers 

slides 

movies 

tape recorder 

records 

art materials 

musical instruments 
paper and pencil 
plants, animals, other 
natural things 
television 
games 

shop equipme nt 
lab equipment 
business machines 
home ec facilities 
sports equipment 
other 



JL 
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Teacher Instructional Strategy, continued 



4* Evaluation 

4. 1 I am responsible for evaluation of student performance 
10 30 50 80 100 % of the time. 









X 





4.2 Please read through the following list of student evaluation factors. 
Rank order the three items you use most when you are making up 
student grades. 

student performance on periodic tests 
standardized 

1 that I make up t 

3 correctness of answers on programmed work (done in class 
or as homework) 

content only of non-programmed work 

correctness of form, neatness, etc., of student work 

originality of student work 

2 oral performance in class 
student effort 

student deportment in class 

Other 
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Teacher Instructional Strategy Suinmary 



TIS 

Area 



Direction 



Structure 



Activation 



Evaluation 



Item 



UL 



1.2 






1.4 



1.5 



Description 



A 



X 



X 



X 



1.6 



1.7 



1.8 

7? ^ x / 7-7-7 



2 . 1 



2.2 



2.3 



zzz zzzz zz 



3. 1 



3.2 



3.3 



3.4 



3.5 



3. 6 



3.7 



3.8 



3*_2. 



ggZ ZIZ Z22lZ 



4. 1 






"X" 



X 



X — 

Z2Z2ZZ 



X 



ZZZZ3 



X 



X 



X 



ZZIZ 



JL 



2ZZ2 



^//// 



X 






Z jLZZZ. 



'ZZZIZ 



X 



X 



JL 



JX. 



_X_ 



///// 



-ZZZ2IZZL 



Z2 ZZZ 



JL 






ZZZZZ! 



Subtotal Average ( 



Circle. 
e( o ne ) f A 






Subtotal Average (Sjine^ 6 ) 



Subtotal Average (^one^ G ) 



^Subtotal Average (^4me* e ) 



10 



A 



TOTAL RESULTS 
(Circle one) 



0 



o 



0 



& 

B 



Directions: 



The teacher’s responses to the Teacher Instructional Strategy Questionnaire 
should be recorded on this Summary. Use the attached Master Questionnaire to 
identify the type of instructional style (A, B, or C) described by the teacher in his 
response to each item. 

Some of the questions on the Teacher Instructional Strategy Questionnaire 
are two-part questions. If the teacher answers the first part of the question in a 
certain way, he is referred to the second part of the question. For example, 
question 1.1: "I provide direction for this course 10%, 30%, 50%, 80%, 100% of 
the time. " Responses at either end of the percentage scale are clearly A or C 
type responses. A teacher response of 50% would seem to indicate that his di- 
rection is mixed. However, before determining this, teacher responses to the 
second part of the question should be checked. Here the teacher may indicate 
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Teacher’s name 



Subject being tau ght So cial Studie s 
Grade level High School 



CLASSROOM OBSERVATION GUIDE 



Teacher Behavior 



1. 



o 

ERIC 



Presenting 

1 . 1 



Of the total time students and teacher spend talking in the class 
the teacher is talking 10 30 50 80 100% of the time 

4 ' — ” _j _j 



czzrzzrxzE 



1.2 

1. 3 



percent of teacher talk related to 
subject matter o? work 
percent of teacher talk not related 
to subject matter or work 



Comprehensibility 
1.4 



1.5 



1.6 

1.7 

1.8 
1. 9 
1. 10 



teacher presents information in logical 
step by step sequence 

teacher uses words that seem to be be- 
yond student comprehension 
teacher talks too loudly 
teacher talks too softly 
teacher talks too fast 
teacher talks too slowly 
teacher uses expressions or examples 
relevant to student age or socio- cultural 
background 



Directing Behavior 

Teachers directions are: 

2 . 1 



simple directions about what materials 
to use and guidelines for working 
2.2 detailed step by step directions about 
how to do work 



Supporting and Assisting Behavior 
3. 1 



3.2 
3. 3 



teacher looks -at students when they 
are talking 

teacher answers student questions 
when student doesn't answer question 
teacher helps him try to answer 



During lesson: 

3.4 teacher expresses confidence in student 



3.5 

3.6 

3.7 



ability to do work 

teacher encourages students' problem- 
solving efforts 

asks for student questions regarding 
understanding of material or task 
recognizes student problem-solving 
efforts 
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X 
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10, 


30 


50 


80 


100% c 



of the tim 









X 




X 










X 










X 










X 










x' 












X 









10 30 50 80 100% of the time 









X 




X 











10 



30 50 ~ 80 100% of the tim< 











X ' 








X 








X 
















X 










X 










X 










X 
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4. 



While students are working, teacher: 

3. 8 walks around room checking student 
work and helping students out 
3. 9 allows students to come to her desk or 
to ask questions from their desks about 
work 

3. 10 allows students to help each other 
3. 11 does not allow students access to any 
assistance 



10 30 50 80 100% of the tim 







• 


X 














X 










X 











When lesson is completed, teacher: 



3. 12 gives or promises feedback on work 
done (i.e. comments on problems 
they had, says when she'll return 
work, etc. ) 

3.13 rewards student efforts (i.e. displays 
student work, gives kids extra play- 
time, etc. ) 









X 










X 





Discouraging Behavior 
When teacher discourages students she is trying to: 



4. 1 
4.2 



4. 3 



put an end to misbehavior 
avoid presentation or discussion 
of non-subject matter topics 
avoid presentation or discussion 
of ideas about subject matter topics 
that differ from her own 



10 30 50 80 100% of the time 



I* 






X 




X 










X 











5. Total Teacher Behavior 



Please indicate percentage breakdown of total teacher behavior across 
the following categories : 

10 30 50 80 100% of t: 

5. 1 presenting 

5. 2 directing 

5.3 supporting and assisting 

5.4 discouraging 













X 










0 **' 


X 








X 











6. Teacher Involvement 



Please indicate percent of total class time teacher seems: 

in ?n c;n u 



6. 1 involved 

6.2 semi-involved 

6.3 distracted 

6.4 uninvolved 









X 




X 










X 










X 











100% of the time 



7. Student Attention 



10 30 50 80 



7. 1 
7.2 
7. 3 

7.4 

7.5 

7.6 



When teacher is talking 
are attentive 

When students are talking 
are attentive 

When students are working 
are attentive 









X 










X 










X 






t 




X 










X 








* 


X 





percent of the students 
percent of the time 
percent of the students 
percent of the time 
percent of the students 
percent of the time 
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8. Teacher Questions 
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10 


30 


50 


80 


100% 


8. 1 




X 








8.2 


X 










8. 3 




X 








8.4 


X 










8.5 


X 












10 


30 


50 


80 


100% 


8.6 




X 








8.7 




X 








8.8 




X 









of the time 

of teachers questions require students to 
recognize or recall correct answer 
of teachers questions require students to 
demonstrate skills 

of teachers questions require students to 
demonstrate their comprehension of ideas 
or concepts 

of teachers questions require students to 
analyze a problem or idea 
of teachers questions require students to 
express their own opinions or attitudes 



of the tirpe teacher designates individual 

student to answer question 

of the time teacher designates the whole 

group to answer question 

of the time teacher designates no one to 

answer question 



Student Response 

Students respond to teacher questions: 

9. 1 only when called on 
9.2 without being called on 
•9.3 en masse 

9.4 students talk without being 
asked questions 

Students questions and comments are about: 

9. 5 how to carry out task 

9.6 substantive content of lesson 

9. 7 topics not related to subject matter 



10 30 50 80 100% of the time 





X 










X 
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X 










X 












X 






X 
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10. Classroom Activities 



Please indicate percent of total class time taken up by the following types 



of activities : 



Actual Activities Time. Budget 



-teacher lecture or demonstration 
.individual students reading aloud 
•teacher -student question and answer 
session 
-discussion 

•students reading at desk 
-students doing lab or shop work 
•students working in small groups 
(games, discussions, etc.) 

•students doing programmed work 
at desk (i.e. workbook exercises, 
etc. ) 

-students doing nonprogrammed 
work at desk (i.e. essay writing, 
etc. ) 
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Output Summary: Teacher Incentive Program 

The Student -Teacher 'Match Chart indicates that the teacher is using 
a highly directive instructional strategy with students whose preferences 
tend to be mixed directive and non-directive. It would seem that the teacher 
was trying to enhance adequacy of curriculum coverage by trading -off student 
motivational factors. 

The output for degree of curriculum coverage shows that he still is 
not covering the curriculum adequately: he is at the upper edge of typical 
thresholds on activities requiring no student participation; he has no acti- 
vities involving a high degree of student participation; he has only a mini- 
mum amount of activities involving total student participation. 

Output for the classroom observation indicates that the teacher is 
over directing students in class. He is inclined to solve the students' prob- 
lems for them instead of allowing them to solve problems themselves. The 
responsibility he is placing on students for performing is unreasonable, given 
the low degree of responsibility he is allowing students to assume for carrying 
out their own learning. The output also indicates that student motivation and 
initiative are quite low. 
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BIA EDUCATION PROGRAM DESCRIPTION 



Problem: INADEQUATE INSTRUCTION 



• ! * I . 

. . . » * . ! i 



' 4 t 



/ 



f 



Program Descriptio n: PAY TEACHERS IN RELATION TO STUDENT ACHIEVE- 

MENT: In a 9 -month school year, an academic advancement of 9 months is ex- 
pected. For each extra month, which a child advances, the teacher would receive 
$20. This could only apply to subjects in which standardized tests are given. 
Other teachers could receive a proportional reward on the assumption that, if 
they do their job well, academic achievement in all subjects is improved. 



■ — - - - — - 1 

• 

Pilot Program 


' Operational Program 

a — 


What: . . • 

• * • 

t , 

• 

- - 

• 1* 1 


'Pay teachers on the basis of 
academic achievement change 
in aggregate advancement for 
whole class; eachachvmt unit 
(bymos. ) inexces s. of expected 
stud, advance earns bonus of ^ 


• 

Albschools 

* 1 
* ♦ 

% 

3 _ ..... ' • 


Where: 

— 


* , * 

Ch'erokee Central 

m m , g # 

* « # • ♦ • .• • \ . 

• * • 


All schools 

* « 

• 


When: 

9 

b 


Fall 1969 

. » | , *•'. * • 


Fall, 1970, after successful 
pilot 


How: ' 

* ** . 

•A • 

• • • til ■ 

• 

• 

• 

'C - ■ ■ - ■■■■ 


Test in Sept, and again. in’ 
May; academic advancement . 
determines the basis for the 
bonus. 


4 • 

¥ 

Same j 

, _ . 


Schedule: 

• • » 
• 


Sept. 1969 Test I 
May, 1970 Test II 
Aug. 1970 pay bonus 


■ 'V ' i 


Costs: 

Personnel 


1 ed. spec. • $10k 

1 * . 
1 . 

i • - 


5 0 ed. spec.@i0kea. = 500k \ 

i 

• * * . *» 

. * *. * 

i 


Facilities: 


• • j * < 

Existing , j 


. 4 ♦ j 

Existing ' * 


Equipment: 

w 


1 .* K- ; 4 ' 

None * 1 •’.* v*- * . 

* ••**: * : . . 


r ’ ' 

None 


Other: 

• 

TOTAL: " 

* 

§ # { 


2 tests 1 Q, 000' i>. 

^chr s , ^ $200 
• [ave. = 10, 000 , J 

, $30k mV -234 • 


- tests @ 5k x 250 = 1, 250, 000 
. • (testing once/yr ) 

* rcrr~2-5- 0 •0-?fce arehe 0 0 a* 

(cost/pupil: $10) 50Q < 000 

2.25.0.000 
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Student Preference Inventory (Secondary School Students) 



Please read through the following lists of classroom activities, 
materials, and ways of behaving in class. Mark all of the things you 
like by putting an "X M beside them in the LIKE column. Mark all of 
the things you don’t like by putting an "X” beside them in the DON'T 
LIKE column. If there are some things you neither like nor dislike, 
you don’t have to mark them at all, 



Classroom Activities 



i- 



■ listening to the teacher talk ; 

•answering teacher’s questions 
■reading out loud | 

•reading to myself ! 

•doing problems on the blackboard 
■doing problems or exercises 
•writing compositons or papers 
doing lab experiments j 

•watching the teacher do experiments 
watching teacher demonstrate problems 
at the blackboard 
■taking tests 
doing research 
playing games or having contests in class 
singing ‘ | 

drawing or painting j 

making things in home economics or shop 
listening to music j 

watching movies or television in class 
having discussions in class 
giving reports in front of the class 



Materials and Media 



(-textbooks 

i-workbooks 

-library books 

-pictures 

.-magazine s 

-newspapers 

-slides 



.1 » 
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X 



•X 



X 



X 



X 



X 



X 



X 



X 



X 



X 

1C 



X 



X 



X 



DON'T 



LIKE LIKE 



X 



X 



X 



X 



1C 



X 

"X" 



X 



X 
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Student Preference Inventory ’(cont. ) 

i 

-movies 

-tajje recorder | 

-records 

-art materials 

-musical instruments 

-paper and pencil 

-plants and animals . 

-television j 

-games , , 

'-shop equipment ; | '\ 

j-lab equipment 

! -business machines ' 

f-home economics facilities 
j -other < 

I - 



j 

/ : 

• , i 

Interaction Preferences 



LIKE 

“ X 

— 2 L . 

X 

X 
X 
. X 
. X 
X 

. X 
. X 
. .X 



I* 



* -answering question when teacher calls on me 
-shouting out the answer without being called on X 
-saying an answer when other kids say it at the “ ™ 
' same time J 

.-not answering a question at all 
^getting help from the teacher 

! B -raising my hand and asking teacher question X 

B -raising my hand for teacher to come help 

me at my desk j X 

A-going to teacher’s desk to get help X 

-getting help from other kids X 

-working or playing by myself X 

-working or playing with a few other kids and 
the teacher j X 

-working or playing with a few other kids and 
no teacher j X 

-working or playing with one. other kid X 

-working or playing only with the teacher X 

-helping other kids j .X 

-working in front of the* class at the' blackboard ~~ 
-sitting with other people iri ‘a circle* or' around'* 
a table * l ‘ * ... x 

; -sitting at my desk all the time ” 
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Student Preference Inventory . (cont. ) 



LIKE 



DON’T 

LIKE 



« 9 

working and playing in different parts of the 
room at different times 

■ going to different places in the school or outside 
the school to do different things 

‘•working or playing with the same kids all the time 
-working or playing with different kids different 
! times 



X 



X 



X 






Student Goals * ! 

“ * j 

! * 

Here is a list of some goals you may have for the future. Please 
read over the list and decide which goals are most important and which 
are not so important. If you think a goal is very important, mark a 2 
in the blank space next to the goal. If you think a goal is not very impor 
tant, mark it 0. If you think a goal is sort of important, but not one of 
the most important ones, give it a score of 1# 



» 

I want to stay in school until I graduate from high school 

• • | • 

I want to stay in school until I am old enough to leave 
even though I may not graduate from high school 

When I get out of school, I want to: 

| 

get a job ?ight away 1 

go into a vocational training program 

go to college for four years- 

go to College for more than four years tp become 
something like a doctor or a lawyer 
live near home ! •. .*••• 

live far away from home " li - 



0 



2 

T 



t« . 



STUDENT PREFERENCE INVENTORY SUMMARY 

(Secondary School Level) 

Under the Total Number of Items column in each category, enter 
the number of items of each type which have received plus weights on 
the master inventory. Multiply this number by the given weight for each 
type item and enter this figure in the Total Weight column. Do this for 
^ach type item in each category. 

Add the three figures in the total weight column in each inventory 
category to get the Average Score for that category. Enter this figure 
in the space marked Average Score. 

In the last section of the Inventory Summary, add the three Average 
Scores for each area and divide by three (the number of areas) to got a 
Total Average Score. The Total Average Score will be described A, B, or 
C indicating student preferences for directive, mixed directive and non- 
directive, on non-directive instructional styles. The letter describing stu- 
dent instructional preferences should be entered on the Student-Teacher 
Match Cha.rt on page 50. This will later be compared with the findings of 
the Te?.cher Instructional Strategy to determine the degree of student and 

d kp 

o « 

H £ 



teacher match. 
Materials 



Total average number of A materials 

IS 

C 

Each A material carries a weight of +20 
B 0 

C -33 



. OT 

H Ti±± 



rti rj 

tD S 
H <D 

<D +S 



11 



x +20 
x * 0 
x -33 



= +80 



0 



= z!2_ 



Average Score -1 9 



If the average materials score falls between +50, * students tend 
to prefer mixed directional and non -directional activites. 

If the average materials score falls above +50, students prefer 
directional materials. 

If the average materials score falls below -50, ^students prefer 
non -directional materials. 



Activities 



Total average number of A activities 

B 

C 



3 o | 

O <U 

r Sfc +» 



•y 

+3 0 

tLO H 
•H (1) 
0 £ 

fc? 1 — * 
> . 



x + 12. 5 
x 0 
x -33. 3 



Average Score 



£ 

d b ° 

CO *H 
O 



= ±25. 

= 0 



=hJL 



-42 
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Each A activity carries a weight of +12. 5 
B 0 

C -33 

If the . average activities score falls between +50, the students 
preferences are mixed directional. 

If the \ average activities score falls above +50, the students 
prefer directive activities. 

If the average activities score falls below -50, the students 
prefer non -directional activities. 



Student Preference Inventory Summary (Secondary) 
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Interaction Preferences 



Total average number of A preferences 




B 

C 



6x0 - 0 



5 x -12. 5 = -62.5 



Each A preference carries a weight of +20 Average Score 



0 

-12.5 



C - 12 - 5 

If the. average interaction preference score falls between +50, 
students tend to prefer mixed directive and non-directive interaction. 



.If the . average interaction preference score falls above +50, 
students prefer directive interaction. 

If the average interaction preference score falls below -50, 
students prefer non-directive interaction. , 



TOTAL AVERAGE SCORE: 

Materials -19 
A cti vitie s -42 

Interaction -42 . 5 

TOTAL - 103.5/ 3 = -34.5 TOTAL AVERAGE SCORE 



! 



I 



If Total Average Score falls between +50: A 
If Total Average Score falls above +50: B 

If Total Average Score falls below -50: C 
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Teacher Instructional Strategy, continued 



Long-Range Goals : 

Please read over the following list of long-range goals. Rate the 
goals you think are the highest priority with a 2 . Rate the middle priority 
goals with a 1_; and rate the lowest priority goals with a (). 



Preparing students to get jobs immediately after high school q 

Preparing students to enter vocational training programs 0 

Preparing a few students to go on to college 2 

9 

Preparing students for highly professional jobs (doctors, 

lawyers, engineers, etc.) 1 

Preparing students to live successfully on the reservation ^ 

Preparing students to integrate with Anglo culture 2 

i* 



Teacher Questionnaire : 

The following questionnaire asks several questions about your style 
of instruction. The results of this questionnaire will later be compared 
with the results of the Student Preference Inventory filled out by your stu- 
dents. The comparison will indicate how well your instructional style is 
matched with the instructional preferences of your students. Allow your- 
self about an hour to fill out the questionnaire so that you can give thought- 
ful consideration to your responses. 



Instructional Style 

Please check the box or blank spaces beside the items which most 
closely describe your instructional style. If you select more than one item, 
please rank order your selections. You may choose up to three items. 



1. Direction: 

1.1 I provide the direction for this course 



10 30 


,50 80 100 






X 





If the answer falls within middle range of spectrum, please check 
circumstances under which you provide -direction. 

When I really want to get something done 

When students are unmotivated and are progressing too slowly 

When students are jumping ahead too fast or illogically 

/ 

Only at the beginning of new study units 



Other 












Teacher Instructional Strategy, continued 



1.2 Students provide the direction for this course 



10 30.50 


80 


X 






1 



of the 

o, . 

time 



If answer falls within middle range of spectrum, please check cir- 
cumstances under which students provide direction 



X When I have covered all the necessary work and we have 
some extra time 



When they are motivated and excited by an idea and I want 
to tap their excitement 



When I am frustrated with trying to get them to do what I 
want them to do 



When I am worried about pushing themthrough the work too 
quickly 



Other 



1. 3 For direction I rely most heavily on 

2 My own ideas about how the course should be taught 
I The text book or curriculum outline 
The ideas of my supervisor 
The ideas of other teachers 

Ideas I have read about in journals and books 
Other 



1.4 [10 ^0/ 50 1 80 1 100| % of the time I use the curriculum outline only as 

araerence for doing things my own way 



1.5 



10P(J 50 80 100 % of the time I diverge from the' text book or curriculum 



oul 



l ' £ ffigl sol 50 1 ftp |l OOl % of the time I criticize myself or the text book in front 



ol the students 



1.7 ( ^301 50 ] SOTlOO l % of the time I allow students to criticize me or the 

textbook 



l.g fl^J ^3~o]~5 0 1 8 0 ! 1 0 oj % of the time I encourage students to criticize me or 
the text book. 
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Teacher Instructional Strategy, continued 



2, Structure: 



Please check the item or items (up to three items) which are most 
descriptive of the way you work. If some are irrelevant, please cross them 
out. If you check more than one item, please rank order your selections from 
most often to least often used style. 



2 . 1 



In each class I try to present information and concepts in a 
clear and logical order 



I generally try to follow a logical progression of information 
and concepts for the whole course, but structure my day-to- 
day teaching more loosely depending on the mood of the stu- 
dents 



I try to present information and concepts within a subject area 
to the students as they need them or seem especially receptive 
to them even though that means I may not know exactly what 
I'll be teaching from one week to the n£xt 



I try to present information and concepts across all subject 
areas to the students as they need them or seem especially 
receptive to them even though that means we may start discussing 
social studies in the middle of what started out to be. a science 
lesson 



Other 



2.2 



When I. change from a tightly structured style to a more loosely 
structured one, it is usually because: 



I am bored 



I am tired of planning everything out very carefully 
My supervisor has suggested that I change styles 



I have been inspired to change from having talked to or 

observed other teachers 



I have been inspired to change from having read something 

in a book or journal 



The students seemed bored 



The students get very excited about an idea that’s not included 
in the lesson plan and I want to help them understand it while 
their motivation is high 
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Teacher Instructional Strategy, continued 



(2,2 continued) 

1 The students are progressing too slowly 

The students are progressing too quickly 

I just can't be that organized all the time 

Other 



2. 3 When I change from a loosely structured style to a more tightly 
structured one it is usually because 

1 The students are progressing, slowly 

The students are progressing too quickly 

I am having trouble keeping the class in order 

My supervisor has suggested that I change styles 

3 I have been inspired to change from haVing talked to or 
observed another teacher 

I have been inspired to change from having read something 
in a book or journal 

2 I found I need to work within a less ambiguous framework 
Other 



3 . Activation : 

3. 1 I initiate class activities 10 30 50 80 100 % of the time. 

I I I "I i X j 

I‘f answer falls within middle range of spectrum, please check 
circumstances under which you initiate activities 



o 
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When I really want to get something done 

When students are sluggish and I want to get them busy 

When students are unruly, and I want to settly them, down 

When we have a visitor in class, and I want to make sure 
everything runs smoothly 

Other 



115 “ 2 4 3r 






BHtfttlUIMMMttailiiaiMMKii 










mm 



j,m>*u< lmm* «v>P* ' A 









Teacher Instructional Strategy, continued 



3.2 Students initiate class activities 10 30 50 80. 100 % of the time. 



X 



I 1= 3 



If answer falls within middle range of spectrum, please check 
circumstances under which students intiate activities. 



When I have covered all the necessary work, and we have 
some extra time. 

On special occasions like right before vacations 

When they have been especially good and I want to reward 
them 

When they are really excited about doing something and I 
want to take advantage of the ir motivation 



When I am tired or bored 

When I think they have a better idea about what to do than 
I have 



Other 



3.3 1 get most of my ideas for activities from 

1 Teachers' guide 
Supervisor 

2 myself 

3 Other teachers 
Books and articles 

The kids 

• Other 

3.4 I usually plan activities that will 

1 Best help me teach the concepts and, skills within the subject area 

To meet the needs of the slower students 
2 To meet the needs of the brighter students 
3 To meet the needs of the average students 

That will keep the class orderly and manageable 

* » 

Be novel for the students and excite their curiosity 



Other 
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Teacher Instructional Strategy, continued 



3. 5 When more than one activity is going on in the class at the same 
time, it is usually because 

I have more than one grade in the same room r 

1 I want to keep the rest of the kids busy while I'm giving 
my attention to a small group within the class 

I am trying to tailor activities to meet the needs of stu- 
dents of different achievement levels within the class 

Different groups of students like to do different things, and 

I want to take advantage of their motivation 

I simply find it exciting to have a couple of activities going 

on at one time 0 

Other 

3. 6 When I teach this course I usually like to 

1 Work with the whole class at once 

2 Divide the class into several small groups and work with one 
group at a time 

3 Walk around the class and help each student personally 
Get the students to help each other 

Sit at my desk while the students are working and have them 

come to me for help 

Other 




3. 7 When I ask the class questions I usually like to 

•2 designate a student to anwer a question before I ask it 
Let any student call out the answer 

Ask a question and call on whoever raises their hand 

Ask a question and have the students respond en masse 

1 Ask a question and designate a student to answer it whether 
he raises his hand or not 

Other 
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Teacher Instructional Strategy, continued 



3. 8 Please rank order the three activities you use most in teaching this 
course. 

3 Lecturing or talking in front of the class 

1 Question and answer sessions with the whole class 
Group discussion with the whole class 

Breaking class into several small discussion groups 

Breaking class into several small work groups 

2 Have kids do programmed work at desk (workbooks, written 
exercises, etc. ) 

0 

Have kids do non -programmed work at desks (write essay, etc. ) 

Have kids work at the black board while rest of class watches 

Demonstrating experiments for whole group 

Supervising student lab work (science ^.ab, shop, home J ec) 

Having students read aloud to rest of class 

Having students read to themselves at their desks 

Having contests and playing games 

Other 
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Teacher Instructional Strategy - continued 



3. 9 Please read through the following list of classroom materials and 
media. Rank order the three items you use most. 



Elementary School 

text book 

workbook 

story books 

magazines and comic books 

movies 

slides 

tape recorder 

records 

toys 

games 

art materials 

paper and pencil 

blocks 

pictures 

animals, plants, other 
natural things 

black board 

bulletin board 

television 

musical instruments 

lab equipment 

other 

.• [ I 



Secondary School 

1 text book 
workbook 

library books 

.reference 

fiction 

nonfiction 

pictures 

magazines 

newspapers 

slides 

3 movies 

tape recorder 

records 

art materials 

musical instruments 

2 paper and pencil 
plants, animals, other 
natural things 

television 

games 

shop equipme nt 

lab equipment 

business machines 
’ home ec facilities 
sports equipment 
~ other 
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Teacher Instructional Strategy, continued 



4, Evaluation 

4, 1 I am responsible for evaluation of student performance 
10 30 50 80 10 0 % of the time. 

I Tx 



4.2 Please read through the following list of student evaluation factors. 
Kank order the three items you use most when you are making un 
student grades. 5 H 



student performance on periodic tests 
J : — standardized 
that I make up 

_2_ correctness of answers on programmed work (done in class 
or as homework) 

content only of non -programmed work 

correctness of form, neatness, etc, , of student work 

originality of student work 

3 oral performance in class 

student effort 

student deportment in class 

Other 
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Teacher Instructional Strategy Summary 



TIS 

Area 



Direction 



l 



(f 



Structure 



Activation 






Item 



1; 1 



1.2 



1. 3 



1.4 



1.5 



Description 



A 

"X" 



JL 



X 



X 



1.6 



1. 7 



1.8 



+ J / S / / / / 



TZZ7ZZ 



2 . 1 



2.2 



2. 3 



/ ^ / 7I2IZ2IZ. 



3. 1 



3.2 



3.3 



3.4 



3.5 



375" 



3.7 



3.8 



1^9 



Evaluation 






4. 1 



✓ >* ✓ z z 



X 



X 



X 



X /V 



X 



X 



zzz 



7 



X 



X 



X 



X 



X 



z2 ? z 



"3T 



: z zzzz 



B 



X 






///// 



X 



X 



X 



7//// 



Z ZI ZZ Z Z 



/✓ 



Oil* cIg 

Subtotal Average ( one ) 






Ci.!T clo 

Subtotal Average ( one ) 



////// 






Subtotal Average (^ne* 6 ) 



B 



3 



r ;r <A 



Subtotal Average ( 



ca 



xrclev 
one JIA ^ 



B 



B 



TOTAL RESULTS 
(Circle one) 



0 



B 



B 



C 



Directions:. 



The teacher’s responses to the Teacher Instructional Strategy Questionnaire 
should, be recorded on this Summary. Use the attached Ivlastcr Questionnaii e to 
identify the type of instructional style (A, B, or C) described by the teacher in his 
response to each item. 

Some of the questions on the Teacher Instructional Strategy Questionnaire 
are two-part questions. If the teacher answers the first part of the question in a 
certain way, he is referred to the second part of the question. For example, 
question 1. lj "I provide direction for this course 10%, 30%, 50%, 80%, 100% of 
the time. " Responses at either end of the percentage scale are clearly A or C 
type responses. A teacher response of 50% would seem to indicate that his di- 
rection is mixed. However, before determining this, teacher responses to the 
second part of the question should be checked. Here the teacher may indicate 
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Teacher's name 
Subject being 



Grade level High School 
CLASSROOM OBSERVATION GUIDE 



Teacher Behavior 



1. 



2 . 



3. 



o 

ERIC 



Presenting 

1. 1 



Of the total time students and teacher spend talking in the class 
the teacher is talking 10 30 50 80 100%^ of the time 



-X 



1.2 

1.3 



percent of teacher talk related to 
subject matter oT work 
percent of teacher talk not related 
to subject matter or work 



Comprehensibility 

1.4 



1.5 



1.6 

1.7 

1.8 
1.9 
1. 10 



teacher presents information in logical 
step by step sequence 

teacher uses words that seem to be be- 
yond student comprehension 
teacher talks too loudly 
teacher talks too softly 
teacher talks too fast 
teacher talks too slowly 
teacher uses expressions or examples 
relevant to student age or socio- cultural 
background 



Directing Behavior 
Teachers directions are: 



2 . 1 



simple directions about what materials 
to use and guidelines for working 
2.2 detailed step by step directions about 
how to do work 



Supporting and Assisting Behavior 

3. 1 



teacher looks .at students when they 
are talking 

3.2 teacher answers student questions 
3. 3 when student doesn't answer question 
teacher helps him try to answer 



During lesson: 

3.4 teacher expresses confidence in student 
ability to do work 

teacher encourages students' problem- 
solving efforts 

asks for student questions regarding 
understanding of material or task 
recognizes student problem-solving 
efforts 



3. 5 
3. 6 
3.7 
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While 

3.8 


students are working, teacher: 

walks around room checking student 
work and helping students out 


10 


30 


50 


80 , 


100% 






X 






3.9 


allows students to come to her desk or 
to ask questions from their desks about 
work 




X 








3. 10 
3. 11 


allows students to help each other 
does not allow students access to any 
assistance 


X 










X 










When lesson is completed, teacher: 


• 








3. 12 


gives or promises feedback on work 
done (i.e. comments on problems 
they had, says when she'll return 
work, etc. ) 








X 




3. 13 


rewards student efforts (i.e. displays 
student work, gives kids extra play- 
time, etc. ) 






X 







Discouraging Behavior 



4. 1 put an end to misbehavior 
4. 2 avoid pr esentatibnor discussion 
of non- subject matter topics 

4.3 avoid presentation or discussion 

of ideas about subject matter topics 
that differ from her own 



JL0 


30 


50 


80 


100% 


X 
















X 




X 











Total Teacher Behavior 

Please indicate percentage breakdown of total teacher behavior across 
the following categories : 

10 ^0 50 ftO 100% nf f 

5. 1 presenting 

5.2 directing 

5.3 supporting and assisting 

5.4 discouraging 
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Teacher Involvement 



Please indicate percent of total class time teacher seems: 

10 *n £0 « 

6.1 

6.2 

6.3 

6.4 



involved 
s emi - involved 
distracted 
uninvolved 
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X 










X 










■ 











Student Attention 

7. 1 When teacher is talking 

7 .b are attentive 

7. 3 When students are talking 

7.4 are attentive 

7.5 When students are working 

7.6 are attentive 



100% of the time 



10 30 50 80 100% of the time 









X 










X 










X 






1 




X 










X 


, 






# 


X 





percent of the students 
percent of the time 
percent of the students 
percent of the time 
percent of the students 
percent of the time 
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8. Teacher Questions 



1 




10 


30 


50 


80 


100% 




8. 1 






. X 






t. 

f 


8.2 


X 
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8.3 
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8.4 
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8.5 j 
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10 


30 


50 


80 


100% 
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00 
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X 
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8.7 


X 
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8.8 


X 











LI It; Lillie 

of teachers questions require students to 
recognize or recall correct answer 
of teachers questions' require students to 
demonstrate skills 

of teachers questions require students to 
demonstrate their comprehension of ideas 
or concepts 

of teachers questions require students to 
analyze a problem or idea 
of teachers questions require students to 
express their own opinions or attitudes 



of the tirpe teacher designates individual 

student to answer question 

of the time teacher designates the whole 

group to answer question 

of the time teacher designates no one to 

answer question 



Student Response 

Students respond to teacher questions 



9. 1 only when called on 

9.2 without being called on 

9.3 en masse 

9.4 students talk without being 
asked questions 

Students questions and comments are about: 

9. 5 how to carry out task 

9.6 substantive content of lesson 

9.7 topics not related to subject matter 
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"X 1 










x" 1 










X 
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X 











100% of the time 



10. Classroom Activities 



Please indicate percent of total class time taken up by the following types 

A » . i*a j* 'i* m • T"> i i 



of activities 

-teacher lecture or demonstration 
-individual students reading aloud 
-teacher- student question and answer 
session 
-discussion 

-students reading at desk 
-students doing lab or shop work 
-students working in small groups 
(games, discussions, etc.) 

-students doing programmed work 
at desk (i.e. workbook exercises, 
etc. ) 

-students doing nonprogrammed 
work at desk (i. e. essay writing, 
etc. ) 
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PROGRAMS APPLICABLE TO THE 
TEACHER EVALUATION MODEL 



One -year gift membership and subscription to 
a professional teaching organization and journal 

Improvisational theatre techniques 

Master linguist tutor 

Pay teachers in relation to student achievement 
Sabbaticals for teachers 

Video tape classroom monitoring system and 
inter -class and inter -school critiques 
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An Instructional Process Modelto Generate Ed ucational Programs 

The School Process Model, of over -all school administration, and 
the Teacher and Curriculum Evaluation Models, have been described in 
preceding sections. One other model, the Instructional Processes Model 
(IPM) , is needed to integrate the psycho -social dynamics of the teacher, 
curriculum, and classroom, and of the dormitory or other sites of non- 
academic interaction. This model generates educational programs for use 
both inside and outside the classroom. For these purposes, an educational 
program is defined as a particular combination of teachers, teaching tech- 
niques, equipment (if necessary), curriculum materials, and environment, 
designed to achieve specific, operationally defined instructional objectives. 

To produce these program outputs, the IPM needs the following in- 
puts: curriculum requirements, in terms of operationally defined instruc- 

tional objectives; student entry-level capabilities, in terms commensurate 
with the instructional objectives (e. g. , if the objective is to teach students 
to compute the hypotenuse of a right triangle from its two sides, it is neces- 
sary to know whether the student can do square roots); teacher capabilities, 
in terms of substantive knowledge and teaching skills; and the constraints of 

time, space, facilities, and equipment. 

The processing logic of the IPM formulates the output programs from 

the input requirements, resources, and constraints. The process consists, 
basically, of three simple operations: the repeated comparison of the re - 
quirements for and the capabilities of the actors involved, to determine per- 
formance gaps to be closed by programs; the decomposition of performance 
gaps and instructional processes into subordinate components that maybe 
matched more meaningfully than in their aggregates; and the cost -effective- 
ness comparison of alternative mixes of program components, to generate 
the most efficient programs. 

The following is an example of the way in which the IPM may be em- 
ployed. In this case, one of a team of two teachers is using it to generate 
improved classroom procedures, to counter an apparent lack of student mo- 
tivation. The numbers used for each step below match those indicated in 







following flow chart of the entire IPM. 

1. List topics and detail level of curriculum requirements. 

2. Determine requirements for memorization, application, 
accuracy, and cr os s -modal transferability (a measure of 
concept -abstracting capability) of the substantive content 
described in (1) above. 

3. Compare student current capabilities with the require- 
ments of (1) and (2) above. 

4. Compare the instructional objectives derived in (3) above 
with the instructional capabilities offered by the available 
teacher or teachers. 

5. Determine from this comparison (4) the instructional 
capability gaps to be filled; that is, those instructional ob- 

■ jectives that cannot be achieved by the available teacher or 

teachers . 

6. Identify relevant student dynamics from entry-level 
characteristics and from observation --for example, 
tendency to prefer work in small groups, sex grouping, 
group criticism of any apparent "leaders, " etc. 

7. Determine student cognitive and affective (motivational) 
needs in the context of the curriculum requirements (2), 
student characteristics matching with these requirements 
(3), and student social dynamics (6). 

8. Decompose the instructional "supplies” and the student 
"learning demands" into their component elements. 

9. From the components determined in (8), construct a 
profile of the cognitive and affective requirements for an 
educational program. 

10. Select from an inventory of instructional processes 
(see the Curriculum and Teacher Evaluation Models) those 
most relevant to the requirements profiled in (9). 

11. Generate additional, innovative processes relevant to 
the requirements by a process of relevant continuum defi- 
nition, esqperimental movement to the extremes of the con- 
tinua, selection of apparently useful values along the con- 
tinua, and exploration of all possible combinations of the 
continua and the selected values on them. That is, consider 
first the most extreme means of obtaining given goals, as 
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for example, holding class fourteen hours each day in 
order to maximize learning, or two hours each day to 
maximize student enjoyment. Consider, at the same 
time, what other objectives are neglected by such ex- 
treme concentration. Then consider a variety of gra- 
dations between these extremes. 

12. Match requirements with the alternatives gener- 
ated in (10) and (11). 

13. Select feasible alternative programs responding to 
the requirements from the several alternative means - 
requirements matching (12) and acceptability constraints. 

14. Compare the alternative programs for relative cost- 
effectiveness on the basis of criteria of effectiveness de- 
rived from curriculum and behavioral requirements. 
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IPM Program Examples 

The four examples of programs described below were selected 
on the basis of their being too broad to be evaluated by either the Teacher 
or Curriculum Evaluation Models, but too concentrated on the special area 
of instruction to be evaluated by the School Process Model of overall 
school administration. 

Thus, programs concerned chiefly with improving teacher commun 
ications with students, such as Indian language training for teachers, are 
to be evaluated by the Teacher Evaluation Model. Programs concerned 
with curriculum development are to be evaluated by the Curriculum Eval- 
uation Model. Programs relating to school administration, such as con- 
tract schools and standardized testing, are to be evaluated by the School 
Process Model. It is the programs falling in between these areas and 
concerned with instruction affected by more than a single teacher or set 
of curriculum materials alone that are to be generated and evaluated by 
the Instructional Processes Model (IPM). 




ool Process Model 



Currie. 
Evaluation 
Model 



Teacher 

Evaluation 

Model 




Instructional Process Model 






Among the programs generated or evaluated by the IPM are: 

cash dividends for student achievement, for purposes of 
motivation; 

tutoring of infants, to reduce language and cultural 
H barriers; 

small seminar groups with student- selected topics to in- 
crease motivation and change teachers' role from custo- 
< dian to educator (may also be evaluated by Teacher Evalu 
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ation Model) ; 



student rating of teachers to motivate teacher responsiveness 
to student needs (may also be evaluated by Teacher Evalua- 
tion Model); 



s 



student -teacher role reversal, to change teacher's role from 
custodian to educator; 



student intra- school academic competitions, to increase \ 

motivation; j 

I 

I 

classroom student teams, to increase motivation; i 

upward bound from elementary to high school, to increase J 

motivation; | 

1 



separation of students by sex for classroom work, to reduce 
student inhibitions ; 

high school work/study program to increase motivation and 
development of employable skills (could'also be evaluated 
by School Process Model); 

master tutor program for improved motivation (could also 
be evaluated by Teacher Evaluation Model); 

academic competitions among BIA schools to increase mo- 
tivation and reduce cultural and geographic isolation; 

Indian Corps (Red Berets) for on- reservation service pro- 
jects, to increase motivation and personal development; 

instructionally "active" school buildings to increase student 
interest in the physical and social sciences (could also be 
evaluated by School Process Model); 

student -produced educational films and texts to reduce 
language barriers; 

intensive school dramatics program of weekly plays pre- 
pared by students to reduce language and cultural 
barriers ; 

elementary school zoos, to motivate interest in biological 
and social sciences; 

mechanical "zoo" or micromuseum to give students working 
familiarity with contemporary technology; 
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I long summer field trips to reduce cultural and geographic 

| isolation; 

| many short-range field trips, to increase motivation and 

| career orientation; 

I 

I on-bus, on-line education to improve instruction; 

I paraprofessional teaching aides to improve instruction; 

teacher- counselors, to improve counseling relevance to 
I learning problems; 

I 

I ' pupil exchange program of foster homes to reduce cultural 

I isolation; 



biographical films of successful contemporary Indians to 
provide positive role models for student achievement (could 
also be evaluated by Curriculum Evaluation Model); 



home service centers located at schools to encourage 
parents to observe classes and visit students and teachers; 

year of work before college to reduce college dropout rate 
among Indians; 

integrated BIA schools, including non-Indian pupils (could 
also be evaluated by School Process Model). 



touring Indian success models, to increase motivation; 

[ 

| traveling shows to reduce cultural isolation; 

ift 

I periodically centralized schools as an alternative to full- 

l time boarding or very small dispersed schools; and 

j home instruction by siblings, using games, to increase 

instructional effectiveness. 



The four examples of program cost-effectiveness evaluation with 
the IPM have been selected for their relative complexity and potential 
F significance; they are, therefore likely to illustrate all aspects of the 

model's uses. They are: 

i? 

cash dividents for student achievement; 
l classroom student teams to increase motivation; 
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upward bound from elementary to high school; and 

separation of students by sex in classes. 

The flow-chart of the IPM is followed through below, step by step, 
for these four programs. Either those steps that cannot be filled in for a 
program are inapplicable, or the program needs to be defined further. 
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Cost-Effectiveness Comparison of Four Example Programs 

Comparison of these four programs with each other depends on the 
degree to which they are directed to a common set of goals. Programs 1, 

2 and 3 are all motivationally oriented, and therefore share at least the 
goal of increasing student motivation. The actual performance of each 
approach in achieving higher student motivation can be determined only by 
experimental trial. However, the costs of all three may be estimated and 
a 'break-even 1 requirement for effectiveness estimated, as follows. 

Let it be assumed that the cash reward program costs $2„ 80/pe.r 
student/per year, the classroom student teaming costs $3. 00/ per student/ 
per year (for teacher training), and the upward -bound -to -high- school pro- 
gram costs $266. 00/per student/per year. To be equally cost-effective, 
the effectiveness ratio of the three programs must be 2. 80/2. 80: 3. 00/ 

2.80: 266.00/2.80, or 1 : 1.07 : 95, for programs 1, 2 and 3, respectively. 
The upward-bound program would therefore have to be more than 95 times 
as effective as the cash rewards program to be consid 'red more cost- 
effective. 
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